2024-04-25T13:26:23.936 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T13:26:23.937 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --description fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/mdtest} --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167 --verbose --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/orig.config.yaml 2024-04-25T13:26:23.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:26:24.075 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/mdtest} email: pdonnell@redhat.com first_in_suite: false job_id: '7673167' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNB1gK2Rz7GR7V46BAlFT2z9wBUgRkRll4H5UxK9mI4aFkg/bXaCJLoCwi3DVxiiR/npzETWCiLIxWfOHrzICLk= smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGkwrDHxjAsHUMPe5TIAwsjHmJGrG7n/YR+QSRfUyWJrAC+Sk59+AZY2XuyT0dXVIn94QHYLeB6ut5oCi+ADaQo= smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI6wALdQJpDmyF6rJs4MvFMTAi2oI6/8R+ByX9gZClNKQootgrvHtGByp6g+AQy8Yahvl4Ic2eivG2nhY54AHug= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7fXcopA+J/wquQ+J9askOazGSyzV7zl4ynG3zRdy9IjzVb1Q6wCaqCVA0rqaxO3hA0O9pOFcZnz66qc/GTze4= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAKkyKBRGdbeAQ3YtkCY15z1MGdRAjlioV7NFtvuxpIBjyf9bBHCJPhi1pkzjHfcYVzlIsVXtKoLcuL1PrrVGso= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - pexec: clients: - set -x - cd $TESTDIR - sudo apt purge -y mpich - sudo apt install -y mpich - wget http://download.ceph.com/qa/ior-3.3.0.tar.bz2 - tar xvfj ior-3.3.0.tar.bz2 - cd ior-3.3.0 - ./configure - make - make install DESTDIR=$TESTDIR/binary/ - cd $TESTDIR/ - sudo apt install -y tree - tree binary/ - rm ior-3.3.0.tar.bz2 - rm -r ior-3.3.0 - ln -s $TESTDIR/mnt.* $TESTDIR/gmnt - ssh_keys: null - mpi: exec: $TESTDIR/binary/usr/local/bin/mdtest -d $TESTDIR/gmnt -I 20 -z 5 -b 2 -R - pexec: clients: - rm -f $TESTDIR/gmnt/ior.testfile - rm -f $TESTDIR/gmnt - rm -rf $TESTDIR/binary teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T13:26:24.076 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T13:26:24.076 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T13:26:24.076 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T13:26:24.078 INFO:teuthology.task.internal:Checking packages... 2024-04-25T13:26:24.102 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T13:26:24.102 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T13:26:24.102 INFO:teuthology.packaging:ref: None 2024-04-25T13:26:24.102 INFO:teuthology.packaging:tag: None 2024-04-25T13:26:24.102 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T13:26:24.102 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:26:24.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T13:26:24.247 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:26:24.248 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T13:26:24.255 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T13:26:24.255 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T13:26:24.268 INFO:teuthology.task.internal:Saving configuration 2024-04-25T13:26:24.286 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T13:26:24.292 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:26:24.316 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:31.604191', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEcaZ8czTtbYnsCAnNd+0wxIQekF+aYj4+VLxP3rty3y'} 2024-04-25T13:26:24.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:31.600761', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICBNHjJJVC8qeGOhXjsKBun+RoB7JihmORQVAosE7e6K'} 2024-04-25T13:26:24.363 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:31.602022', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFnDOziXKuAbwZQ+ZircxXG9lxLCkYnQ2HnIE1Bghgzr'} 2024-04-25T13:26:24.388 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:31.603121', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBzqQfO3vCVeLyh0lwVivCx+phQtRrJAzQPWw4esI5IV'} 2024-04-25T13:26:24.410 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:31.605734', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIArPi2HkkvduwO5Z4bQAd+Cascs8WW3CUPCgHeyHE//x'} 2024-04-25T13:26:24.410 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T13:26:24.416 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-25T13:26:24.416 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T13:26:24.416 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['client.0'] 2024-04-25T13:26:24.417 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['client.1'] 2024-04-25T13:26:24.417 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['client.2'] 2024-04-25T13:26:24.417 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T13:26:24.591 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f38f7926e50>, signals=[15]) 2024-04-25T13:26:24.591 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T13:26:24.598 INFO:teuthology.task.internal:Opening connections... 2024-04-25T13:26:24.598 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:26:24.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:24.689 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:26:24.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:24.771 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-04-25T13:26:24.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:24.851 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T13:26:24.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:24.931 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:26:24.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:25.015 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T13:26:25.022 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-04-25T13:26:25.028 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-04-25T13:26:25.028 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-04-25T13:26:25.076 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T13:26:25.076 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2024-04-25T13:26:25.076 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="22.04" 2024-04-25T13:26:25.076 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T13:26:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=jammy 2024-04-25T13:26:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2024-04-25T13:26:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2024-04-25T13:26:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T13:26:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T13:26:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T13:26:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T13:26:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=jammy 2024-04-25T13:26:25.078 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-04-25T13:26:25.097 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-04-25T13:26:25.103 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-04-25T13:26:25.103 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="22.04" 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=jammy 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T13:26:25.152 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=jammy 2024-04-25T13:26:25.153 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-04-25T13:26:25.172 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-04-25T13:26:25.178 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-04-25T13:26:25.178 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-04-25T13:26:25.224 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T13:26:25.224 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2024-04-25T13:26:25.224 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2024-04-25T13:26:25.224 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T13:26:25.224 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2024-04-25T13:26:25.225 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2024-04-25T13:26:25.225 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2024-04-25T13:26:25.225 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T13:26:25.225 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T13:26:25.225 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T13:26:25.225 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T13:26:25.225 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2024-04-25T13:26:25.226 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-04-25T13:26:25.256 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-04-25T13:26:25.262 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-04-25T13:26:25.262 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-04-25T13:26:25.309 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T13:26:25.309 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-04-25T13:26:25.309 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2024-04-25T13:26:25.310 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T13:26:25.310 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2024-04-25T13:26:25.310 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-04-25T13:26:25.310 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-04-25T13:26:25.310 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T13:26:25.310 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T13:26:25.310 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T13:26:25.310 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T13:26:25.310 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2024-04-25T13:26:25.310 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-04-25T13:26:25.330 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-04-25T13:26:25.336 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-04-25T13:26:25.336 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-04-25T13:26:25.384 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T13:26:25.384 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2024-04-25T13:26:25.384 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="22.04" 2024-04-25T13:26:25.384 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T13:26:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=jammy 2024-04-25T13:26:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2024-04-25T13:26:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2024-04-25T13:26:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T13:26:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T13:26:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T13:26:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T13:26:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=jammy 2024-04-25T13:26:25.385 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-04-25T13:26:25.405 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T13:26:25.420 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T13:26:25.426 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T13:26:25.427 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:25.430 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:25.432 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:25.435 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:25.437 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:25.442 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T13:26:25.448 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T13:26:25.448 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:25.477 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:25.480 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:25.482 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:25.484 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:25.505 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T13:26:25.633 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T13:26:25.647 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T13:26:25.647 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T13:26:25.648 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:25.648 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:25.649 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:25.649 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:25.649 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:25.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:25.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:25.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:25.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:25.657 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-04-25T13:26:25.657 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-25T13:26:25.657 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-04-25T13:26:25.658 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-04-25T13:26:25.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:25.659 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-04-25T13:26:25.704 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-56-generic 2024-04-25T13:26:25.704 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.15.0-56-generic 2024-04-25T13:26:25.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-04-25T13:26:25.706 INFO:teuthology.orchestra.run.smithi077.stdout:5.15.0-56-generic 2024-04-25T13:26:25.706 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-56-generic 2024-04-25T13:26:25.707 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.15.0-56-generic 2024-04-25T13:26:25.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-get clean 2024-04-25T13:26:25.707 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.15.0-56-generic 2024-04-25T13:26:25.707 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-25T13:26:25.709 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-56-generic 2024-04-25T13:26:25.709 INFO:teuthology.orchestra.run.smithi191.stdout:5.15.0-56-generic 2024-04-25T13:26:25.709 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.15.0-56-generic 2024-04-25T13:26:25.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-04-25T13:26:25.709 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.15.0-56-generic 2024-04-25T13:26:25.709 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get clean 2024-04-25T13:26:25.820 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-04-25T13:26:25.832 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-04-25T13:26:25.843 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2024-04-25T13:26:25.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-get update 2024-04-25T13:26:25.885 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-25T13:26:25.983 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T13:26:26.039 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:26:26.059 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T13:26:26.066 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:26:26.115 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:26:26.115 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T13:26:26.128 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:26:26.128 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T13:26:26.135 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:26:26.135 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T13:26:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T13:26:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T13:26:26.148 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T13:26:26.173 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T13:26:26.176 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T13:26:26.184 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T13:26:26.213 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T13:26:26.287 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T13:26:26.307 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T13:26:26.371 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T13:26:26.381 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T13:26:26.382 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T13:26:26.391 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T13:26:26.430 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T13:26:26.431 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T13:26:26.437 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:26.437 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T13:26:26.456 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T13:26:26.470 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T13:26:26.482 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T13:26:26.485 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T13:26:26.486 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T13:26:26.486 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T13:26:26.488 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T13:26:26.488 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T13:26:26.488 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T13:26:26.501 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T13:26:26.502 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T13:26:26.515 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T13:26:26.528 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T13:26:26.529 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T13:26:26.534 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T13:26:26.536 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T13:26:26.538 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T13:26:26.541 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:26.541 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T13:26:26.542 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T13:26:26.544 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T13:26:26.566 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T13:26:26.570 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T13:26:26.579 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T13:26:26.582 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T13:26:26.609 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T13:26:26.610 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T13:26:26.610 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T13:26:26.610 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T13:26:26.610 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T13:26:26.611 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T13:26:26.619 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T13:26:26.619 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T13:26:26.649 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T13:26:26.650 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T13:26:26.650 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T13:26:26.651 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T13:26:26.651 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T13:26:26.668 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T13:26:26.673 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T13:26:26.675 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T13:26:26.829 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T13:26:26.838 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T13:26:26.840 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T13:26:26.850 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T13:26:26.869 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T13:26:26.982 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T13:26:26.984 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T13:26:26.986 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T13:26:26.997 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T13:26:27.000 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T13:26:27.001 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T13:26:27.008 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T13:26:27.009 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T13:26:27.010 INFO:teuthology.orchestra.run.smithi077.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T13:26:27.010 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T13:26:27.010 INFO:teuthology.orchestra.run.smithi077.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T13:26:27.010 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T13:26:27.012 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T13:26:27.016 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T13:26:27.016 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T13:26:27.019 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T13:26:27.019 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T13:26:27.020 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T13:26:27.020 INFO:teuthology.orchestra.run.smithi191.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T13:26:27.021 INFO:teuthology.orchestra.run.smithi191.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T13:26:27.021 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T13:26:27.023 INFO:teuthology.orchestra.run.smithi077.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T13:26:27.026 INFO:teuthology.orchestra.run.smithi191.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T13:26:27.034 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T13:26:27.035 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T13:26:27.038 INFO:teuthology.orchestra.run.smithi077.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T13:26:27.038 INFO:teuthology.orchestra.run.smithi077.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T13:26:27.040 INFO:teuthology.orchestra.run.smithi077.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T13:26:27.040 INFO:teuthology.orchestra.run.smithi191.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T13:26:27.041 INFO:teuthology.orchestra.run.smithi191.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T13:26:27.043 INFO:teuthology.orchestra.run.smithi191.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T13:26:27.078 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T13:26:27.079 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T13:26:27.090 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:27.092 INFO:teuthology.orchestra.run.smithi077.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T13:26:27.093 INFO:teuthology.orchestra.run.smithi077.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T13:26:27.099 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T13:26:27.100 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T13:26:27.104 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T13:26:27.105 INFO:teuthology.orchestra.run.smithi191.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T13:26:27.105 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T13:26:27.115 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:27.115 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T13:26:27.118 INFO:teuthology.orchestra.run.smithi077.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T13:26:27.118 INFO:teuthology.orchestra.run.smithi077.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:27.118 INFO:teuthology.orchestra.run.smithi077.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T13:26:27.124 INFO:teuthology.orchestra.run.smithi077.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:27.125 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:27.125 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:27.125 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T13:26:27.133 INFO:teuthology.orchestra.run.smithi077.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T13:26:27.138 INFO:teuthology.orchestra.run.smithi191.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T13:26:27.139 INFO:teuthology.orchestra.run.smithi191.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T13:26:27.139 INFO:teuthology.orchestra.run.smithi191.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:27.139 INFO:teuthology.orchestra.run.smithi191.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T13:26:27.140 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T13:26:27.143 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T13:26:27.145 INFO:teuthology.orchestra.run.smithi191.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T13:26:27.154 INFO:teuthology.orchestra.run.smithi191.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T13:26:27.255 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T13:26:27.288 INFO:teuthology.orchestra.run.smithi077.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T13:26:27.289 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T13:26:27.306 INFO:teuthology.orchestra.run.smithi077.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T13:26:27.311 INFO:teuthology.orchestra.run.smithi191.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T13:26:27.314 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T13:26:27.320 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T13:26:27.328 INFO:teuthology.orchestra.run.smithi191.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T13:26:27.713 INFO:teuthology.orchestra.run.smithi077.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T13:26:27.719 INFO:teuthology.orchestra.run.smithi077.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T13:26:27.719 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T13:26:27.725 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T13:26:27.726 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T13:26:27.727 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T13:26:27.732 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T13:26:27.733 INFO:teuthology.orchestra.run.smithi077.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T13:26:27.733 INFO:teuthology.orchestra.run.smithi077.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T13:26:27.734 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T13:26:27.734 INFO:teuthology.orchestra.run.smithi191.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T13:26:27.736 INFO:teuthology.orchestra.run.smithi077.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T13:26:27.739 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T13:26:27.739 INFO:teuthology.orchestra.run.smithi191.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T13:26:27.742 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T13:26:27.746 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T13:26:27.749 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T13:26:27.754 INFO:teuthology.orchestra.run.smithi191.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T13:26:27.754 INFO:teuthology.orchestra.run.smithi191.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T13:26:27.756 INFO:teuthology.orchestra.run.smithi191.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T13:26:27.833 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T13:26:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T13:26:27.873 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T13:26:27.891 INFO:teuthology.orchestra.run.smithi191.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T13:26:27.944 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T13:26:27.964 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T13:26:27.965 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T13:26:27.968 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T13:26:27.969 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T13:26:27.970 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T13:26:27.970 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T13:26:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T13:26:27.975 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T13:26:27.978 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T13:26:27.983 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T13:26:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T13:26:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T13:26:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T13:26:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T13:26:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T13:26:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T13:26:28.003 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T13:26:28.003 INFO:teuthology.orchestra.run.smithi191.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T13:26:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T13:26:28.008 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T13:26:28.009 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T13:26:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T13:26:28.010 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T13:26:28.011 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T13:26:28.011 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T13:26:28.013 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T13:26:28.017 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T13:26:28.023 INFO:teuthology.orchestra.run.smithi191.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T13:26:28.024 INFO:teuthology.orchestra.run.smithi191.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T13:26:28.028 INFO:teuthology.orchestra.run.smithi191.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T13:26:28.029 INFO:teuthology.orchestra.run.smithi191.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T13:26:28.029 INFO:teuthology.orchestra.run.smithi191.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T13:26:28.030 INFO:teuthology.orchestra.run.smithi191.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T13:26:28.034 INFO:teuthology.orchestra.run.smithi191.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T13:26:28.038 INFO:teuthology.orchestra.run.smithi191.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T13:26:28.142 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T13:26:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T13:26:28.182 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T13:26:28.203 INFO:teuthology.orchestra.run.smithi191.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T13:26:28.225 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T13:26:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T13:26:28.265 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T13:26:28.287 INFO:teuthology.orchestra.run.smithi191.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T13:26:28.306 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T13:26:28.346 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T13:26:28.364 INFO:teuthology.orchestra.run.smithi077.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T13:26:28.367 INFO:teuthology.orchestra.run.smithi191.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T13:26:28.387 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T13:26:28.417 INFO:teuthology.orchestra.run.smithi077.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T13:26:28.419 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T13:26:28.427 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T13:26:28.449 INFO:teuthology.orchestra.run.smithi077.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T13:26:28.449 INFO:teuthology.orchestra.run.smithi191.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T13:26:28.457 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T13:26:28.480 INFO:teuthology.orchestra.run.smithi191.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T13:26:32.172 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 13.2 MB in 2s (6,889 kB/s) 2024-04-25T13:26:32.784 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 13.2 MB in 3s (5,222 kB/s) 2024-04-25T13:26:32.841 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 13.2 MB in 3s (5,185 kB/s) 2024-04-25T13:26:32.865 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 13.2 MB in 3s (5,160 kB/s) 2024-04-25T13:26:32.973 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 13.2 MB in 3s (5,213 kB/s) 2024-04-25T13:26:33.446 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-25T13:26:33.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:26:33.523 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-25T13:26:33.718 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-25T13:26:33.718 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-25T13:26:33.893 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:26:33.893 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:26:33.893 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:26:33.893 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:26:33.894 INFO:teuthology.orchestra.run.smithi096.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T13:26:33.894 INFO:teuthology.orchestra.run.smithi096.stdout: python2.7-minimal 2024-04-25T13:26:33.894 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:26:33.895 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-25T13:26:33.895 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:33.895 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T13:26:33.895 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:33.897 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-25T13:26:33.897 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T13:26:33.897 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-25T13:26:33.897 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2024-04-25T13:26:33.943 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-25T13:26:33.943 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:33.943 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T13:26:33.944 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:33.945 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-25T13:26:33.945 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T13:26:34.125 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:26:34.125 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 113 MB of archives. 2024-04-25T13:26:34.125 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T13:26:34.125 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T13:26:34.166 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:26:34.184 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:26:34.244 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:26:34.327 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-04-25T13:26:34.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:26:34.349 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:26:34.367 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:26:34.404 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-04-25T13:26:34.427 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:26:34.432 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:26:34.444 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-25T13:26:34.445 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-25T13:26:34.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:26:34.505 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:26:34.591 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2024-04-25T13:26:34.591 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2024-04-25T13:26:34.619 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:26:34.620 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:26:34.620 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:26:34.620 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:26:34.621 INFO:teuthology.orchestra.run.smithi097.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T13:26:34.621 INFO:teuthology.orchestra.run.smithi097.stdout: python2.7-minimal 2024-04-25T13:26:34.621 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:26:34.622 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-04-25T13:26:34.622 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:34.622 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T13:26:34.622 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:34.623 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-25T13:26:34.623 INFO:teuthology.orchestra.run.smithi097.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T13:26:34.623 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-04-25T13:26:34.624 INFO:teuthology.orchestra.run.smithi097.stdout: thermald 2024-04-25T13:26:34.625 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-25T13:26:34.626 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-25T13:26:34.663 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-25T13:26:34.663 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:34.663 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T13:26:34.663 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:34.664 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-04-25T13:26:34.665 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T13:26:34.703 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-04-25T13:26:34.703 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-04-25T13:26:34.750 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:26:34.750 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:26:34.750 INFO:teuthology.orchestra.run.smithi077.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:26:34.751 INFO:teuthology.orchestra.run.smithi077.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:26:34.751 INFO:teuthology.orchestra.run.smithi077.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T13:26:34.751 INFO:teuthology.orchestra.run.smithi077.stdout: python2.7-minimal 2024-04-25T13:26:34.751 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:26:34.752 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2024-04-25T13:26:34.753 INFO:teuthology.orchestra.run.smithi077.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:34.753 INFO:teuthology.orchestra.run.smithi077.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T13:26:34.753 INFO:teuthology.orchestra.run.smithi077.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:34.754 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2024-04-25T13:26:34.754 INFO:teuthology.orchestra.run.smithi077.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T13:26:34.754 INFO:teuthology.orchestra.run.smithi077.stdout:Recommended packages: 2024-04-25T13:26:34.754 INFO:teuthology.orchestra.run.smithi077.stdout: thermald 2024-04-25T13:26:34.789 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:26:34.790 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:26:34.790 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:26:34.790 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:26:34.790 INFO:teuthology.orchestra.run.smithi191.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T13:26:34.790 INFO:teuthology.orchestra.run.smithi191.stdout: python2.7-minimal 2024-04-25T13:26:34.790 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:26:34.791 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2024-04-25T13:26:34.791 INFO:teuthology.orchestra.run.smithi191.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:34.791 INFO:teuthology.orchestra.run.smithi191.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T13:26:34.791 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:34.792 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2024-04-25T13:26:34.793 INFO:teuthology.orchestra.run.smithi191.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T13:26:34.793 INFO:teuthology.orchestra.run.smithi191.stdout:Recommended packages: 2024-04-25T13:26:34.793 INFO:teuthology.orchestra.run.smithi191.stdout: thermald 2024-04-25T13:26:34.810 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2024-04-25T13:26:34.810 INFO:teuthology.orchestra.run.smithi077.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:34.811 INFO:teuthology.orchestra.run.smithi077.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T13:26:34.811 INFO:teuthology.orchestra.run.smithi077.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:34.812 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages will be upgraded: 2024-04-25T13:26:34.813 INFO:teuthology.orchestra.run.smithi077.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T13:26:34.836 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2024-04-25T13:26:34.836 INFO:teuthology.orchestra.run.smithi191.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:34.836 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T13:26:34.836 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:34.837 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages will be upgraded: 2024-04-25T13:26:34.838 INFO:teuthology.orchestra.run.smithi191.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T13:26:34.843 INFO:teuthology.orchestra.run.smithi097.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:26:34.843 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 113 MB of archives. 2024-04-25T13:26:34.843 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T13:26:34.843 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T13:26:34.863 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:26:34.863 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:26:34.863 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:26:34.864 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:26:34.864 INFO:teuthology.orchestra.run.smithi151.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T13:26:34.864 INFO:teuthology.orchestra.run.smithi151.stdout: python2.7-minimal 2024-04-25T13:26:34.864 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:26:34.865 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-04-25T13:26:34.865 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:34.865 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T13:26:34.865 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:34.866 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-04-25T13:26:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T13:26:34.867 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-04-25T13:26:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: thermald 2024-04-25T13:26:34.872 INFO:teuthology.orchestra.run.smithi077.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:26:34.872 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 113 MB of archives. 2024-04-25T13:26:34.872 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T13:26:34.872 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T13:26:34.896 INFO:teuthology.orchestra.run.smithi191.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:26:34.896 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 113 MB of archives. 2024-04-25T13:26:34.896 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T13:26:34.896 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T13:26:34.912 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-04-25T13:26:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T13:26:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T13:26:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T13:26:34.913 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-04-25T13:26:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T13:26:34.970 INFO:teuthology.orchestra.run.smithi151.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:26:34.970 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 113 MB of archives. 2024-04-25T13:26:34.970 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T13:26:34.970 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T13:26:35.557 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T13:26:35.739 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T13:26:35.828 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T13:26:35.888 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T13:26:35.950 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T13:26:35.979 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T13:26:36.153 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T13:26:36.245 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T13:26:36.299 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T13:26:36.597 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T13:26:38.078 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T13:26:38.078 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T13:26:38.079 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T13:26:38.218 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T13:26:38.218 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T13:26:38.219 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T13:26:38.624 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T13:26:38.700 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T13:26:38.707 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T13:26:38.707 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T13:26:38.708 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T13:26:38.708 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T13:26:38.708 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T13:26:38.708 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T13:26:38.787 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T13:26:38.787 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T13:26:38.787 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T13:26:38.898 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T13:26:38.938 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T13:26:38.946 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T13:26:38.974 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T13:26:38.997 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T13:26:39.005 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T13:26:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 113 MB in 4s (29.2 MB/s) 2024-04-25T13:26:39.261 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T13:26:39.348 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 113 MB in 5s (22.6 MB/s) 2024-04-25T13:26:39.401 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 113 MB in 4s (27.8 MB/s) 2024-04-25T13:26:39.402 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 113 MB in 4s (27.2 MB/s) 2024-04-25T13:26:39.536 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T13:26:39.615 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T13:26:39.620 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T13:26:40.304 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T13:26:40.417 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T13:26:40.883 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 113 MB in 6s (19.7 MB/s) 2024-04-25T13:26:41.061 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T13:26:41.470 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T13:26:41.476 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:41.486 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T13:26:41.490 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:41.568 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:41.702 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T13:26:41.706 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:41.725 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T13:26:41.729 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:41.751 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:41.883 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:41.962 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:42.996 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T13:26:43.000 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:43.058 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:43.737 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T13:26:43.753 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T13:26:43.758 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:43.774 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:43.849 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:43.867 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:44.214 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T13:26:44.233 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T13:26:44.234 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:44.255 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:44.290 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T13:26:44.310 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:44.315 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T13:26:44.323 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:44.335 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:44.343 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:44.348 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:44.841 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T13:26:44.862 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:44.862 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T13:26:44.882 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:44.936 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:45.085 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T13:26:45.107 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:45.204 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:45.697 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T13:26:45.717 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:45.755 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:50.650 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:50.778 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:51.059 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:51.077 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:51.186 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:51.198 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:51.527 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T13:26:51.545 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:51.549 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T13:26:51.593 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:26:51.665 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:51.865 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:51.901 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T13:26:51.912 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T13:26:51.951 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:26:52.001 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:52.139 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:52.267 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:52.351 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:52.441 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:52.480 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:52.566 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:52.608 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:52.712 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:52.791 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T13:26:52.811 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T13:26:52.874 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:26:52.958 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:26:52.990 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T13:26:53.013 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T13:26:53.057 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:26:53.087 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:26:53.391 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T13:26:53.414 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T13:26:53.458 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:26:57.614 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T13:26:57.651 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:57.689 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:57.928 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T13:26:57.966 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:58.010 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:58.856 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T13:26:58.893 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:58.931 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:59.150 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T13:26:59.187 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:59.242 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:26:59.817 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T13:26:59.855 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T13:26:59.892 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:00.315 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:27:00.444 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:27:00.557 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:27:00.671 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:27:00.794 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:27:00.899 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:00.971 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:27:01.016 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T13:27:01.076 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:01.145 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:01.202 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T13:27:01.923 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:02.116 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:27:02.294 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:27:02.486 INFO:teuthology.orchestra.run.smithi077.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:02.486 INFO:teuthology.orchestra.run.smithi077.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:02.486 INFO:teuthology.orchestra.run.smithi077.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:02.486 INFO:teuthology.orchestra.run.smithi077.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:02.627 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:27:02.748 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:02.749 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:02.875 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T13:27:03.003 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:03.061 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:27:03.211 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:27:03.466 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:03.466 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:03.466 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:03.466 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:03.586 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:27:03.624 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:03.699 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:03.733 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T13:27:03.842 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T13:27:03.880 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T13:27:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:04.150 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:04.239 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T13:27:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:04.385 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:04.464 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:04.536 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T13:27:04.698 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:05.035 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:05.327 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:05.327 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:05.328 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:05.328 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:05.506 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:05.509 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T13:27:05.635 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T13:27:05.770 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T13:27:05.837 INFO:teuthology.orchestra.run.smithi077.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:05.842 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:05.998 INFO:teuthology.orchestra.run.smithi191.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:05.999 INFO:teuthology.orchestra.run.smithi191.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:05.999 INFO:teuthology.orchestra.run.smithi191.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:05.999 INFO:teuthology.orchestra.run.smithi191.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:06.192 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:06.418 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T13:27:06.519 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T13:27:06.620 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:06.670 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T13:27:06.670 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:06.950 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:07.242 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T13:27:08.010 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T13:27:08.103 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:08.111 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:08.170 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T13:27:08.170 INFO:teuthology.orchestra.run.smithi097.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:08.725 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T13:27:08.843 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T13:27:08.969 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:09.036 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T13:27:09.036 INFO:teuthology.orchestra.run.smithi151.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:09.520 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T13:27:09.680 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T13:27:09.839 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T13:27:09.894 INFO:teuthology.orchestra.run.smithi191.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T13:27:09.895 INFO:teuthology.orchestra.run.smithi191.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:19.642 INFO:teuthology.orchestra.run.smithi077.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T13:27:19.642 INFO:teuthology.orchestra.run.smithi077.stdout:Sourcing file `/etc/default/grub' 2024-04-25T13:27:19.651 INFO:teuthology.orchestra.run.smithi077.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:19.678 INFO:teuthology.orchestra.run.smithi077.stdout:Generating grub configuration file ... 2024-04-25T13:27:19.913 INFO:teuthology.orchestra.run.smithi077.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:19.936 INFO:teuthology.orchestra.run.smithi077.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:20.223 INFO:teuthology.orchestra.run.smithi077.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:20.228 INFO:teuthology.orchestra.run.smithi077.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:20.303 INFO:teuthology.orchestra.run.smithi077.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:20.440 INFO:teuthology.orchestra.run.smithi077.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:20.441 INFO:teuthology.orchestra.run.smithi077.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:20.441 INFO:teuthology.orchestra.run.smithi077.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:20.481 INFO:teuthology.orchestra.run.smithi077.stdout:done 2024-04-25T13:27:20.597 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T13:27:20.597 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2024-04-25T13:27:20.610 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:20.634 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2024-04-25T13:27:20.948 DEBUG:teuthology.orchestra.run.smithi077:> dpkg -s linux-image-generic 2024-04-25T13:27:20.970 INFO:teuthology.orchestra.run.smithi077.stdout:Package: linux-image-generic 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Status: install ok installed 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Priority: optional 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Section: kernel 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Installed-Size: 21 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: amd64 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Source: linux-meta 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:Recommends: thermald 2024-04-25T13:27:20.972 INFO:teuthology.orchestra.run.smithi077.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:20.972 INFO:teuthology.orchestra.run.smithi077.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:20.972 INFO:teuthology.orchestra.run.smithi077.stdout: available. 2024-04-25T13:27:20.972 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T13:27:20.972 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T13:27:20.972 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T13:27:20.972 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T13:27:20.972 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi077.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T13:27:20.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-get clean 2024-04-25T13:27:20.976 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:20.992 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:21.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-get update 2024-04-25T13:27:21.381 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:21.387 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:21.428 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:27:21.428 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:27:21.449 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:21.456 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:21.499 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:27:21.581 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:27:21.613 INFO:teuthology.orchestra.run.smithi096.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:21.613 INFO:teuthology.orchestra.run.smithi096.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:21.613 INFO:teuthology.orchestra.run.smithi096.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:21.642 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-04-25T13:27:22.014 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T13:27:22.014 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub' 2024-04-25T13:27:22.023 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:22.043 INFO:teuthology.orchestra.run.smithi097.stdout:Generating grub configuration file ... 2024-04-25T13:27:22.098 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-25T13:27:22.118 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:22.119 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:22.120 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-25T13:27:22.120 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T13:27:22.120 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T13:27:22.120 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T13:27:22.120 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-25T13:27:22.120 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T13:27:22.120 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-25T13:27:22.300 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:22.315 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:22.320 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-25T13:27:22.446 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:27:22.446 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:27:22.460 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:27:22.480 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:27:22.607 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:22.613 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:22.682 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:22.686 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:22.842 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-04-25T13:27:22.848 INFO:teuthology.orchestra.run.smithi097.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:22.848 INFO:teuthology.orchestra.run.smithi097.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:22.848 INFO:teuthology.orchestra.run.smithi097.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:22.859 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:27:22.895 INFO:teuthology.orchestra.run.smithi097.stdout:done 2024-04-25T13:27:22.910 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-04-25T13:27:23.096 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2024-04-25T13:27:23.096 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2024-04-25T13:27:23.253 INFO:teuthology.orchestra.run.smithi077.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T13:27:23.254 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:27:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:27:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:27:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:27:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:27:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:27:23.255 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:27:23.292 INFO:teuthology.orchestra.run.smithi077.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:27:23.294 DEBUG:teuthology.orchestra.run.smithi077:> dpkg -s linux-image-generic 2024-04-25T13:27:23.314 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-04-25T13:27:23.337 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-04-25T13:27:23.337 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-04-25T13:27:23.337 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-04-25T13:27:23.337 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:23.338 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-04-25T13:27:23.339 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T13:27:23.339 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T13:27:23.339 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T13:27:23.339 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-25T13:27:23.339 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T13:27:23.339 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-04-25T13:27:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:Package: linux-image-generic 2024-04-25T13:27:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:Status: install ok installed 2024-04-25T13:27:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:Priority: optional 2024-04-25T13:27:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:Section: kernel 2024-04-25T13:27:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:Installed-Size: 21 2024-04-25T13:27:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: amd64 2024-04-25T13:27:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:Source: linux-meta 2024-04-25T13:27:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:Recommends: thermald 2024-04-25T13:27:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:23.351 INFO:teuthology.orchestra.run.smithi077.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:23.351 INFO:teuthology.orchestra.run.smithi077.stdout: available. 2024-04-25T13:27:23.351 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-04-25T13:27:23.395 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.dWE0Kcv4Ul 2024-04-25T13:27:23.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo cp /boot/grub/grub.cfg /tmp/tmp.dWE0Kcv4Ul 2024-04-25T13:27:23.417 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T13:27:23.418 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub' 2024-04-25T13:27:23.434 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:23.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.dWE0Kcv4Ul 2024-04-25T13:27:23.451 INFO:teuthology.orchestra.run.smithi151.stdout:Generating grub configuration file ... 2024-04-25T13:27:23.532 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-04-25T13:27:23.574 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.dWE0Kcv4Ul is 10KB 2024-04-25T13:27:23.586 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.dWE0Kcv4Ul 2024-04-25T13:27:23.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:23.647 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:27:23.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T13:27:23.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:23.654 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:27:23.667 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:27:23.688 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:27:23.710 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T13:27:23.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo update-grub 2024-04-25T13:27:23.761 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-25T13:27:23.765 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:27:23.770 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:23.778 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:27:23.802 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:23.831 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-25T13:27:24.007 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-25T13:27:24.007 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-25T13:27:24.143 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:24.149 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:24.166 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T13:27:24.166 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:27:24.166 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:27:24.166 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:27:24.166 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:27:24.166 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:27:24.167 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:27:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:27:24.206 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:27:24.208 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-25T13:27:24.219 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:24.225 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:24.266 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:24.267 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-25T13:27:24.267 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:24.267 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:24.267 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-25T13:27:24.267 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-25T13:27:24.311 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.dIyQnokYPa 2024-04-25T13:27:24.311 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.dIyQnokYPa 2024-04-25T13:27:24.365 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.dIyQnokYPa 2024-04-25T13:27:24.386 INFO:teuthology.orchestra.run.smithi151.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:24.387 INFO:teuthology.orchestra.run.smithi151.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:24.387 INFO:teuthology.orchestra.run.smithi151.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:24.428 INFO:teuthology.orchestra.run.smithi151.stdout:done 2024-04-25T13:27:24.430 INFO:teuthology.orchestra.run.smithi191.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T13:27:24.430 INFO:teuthology.orchestra.run.smithi191.stdout:Sourcing file `/etc/default/grub' 2024-04-25T13:27:24.455 INFO:teuthology.orchestra.run.smithi191.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:24.483 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.dIyQnokYPa is 10KB 2024-04-25T13:27:24.486 INFO:teuthology.orchestra.run.smithi191.stdout:Generating grub configuration file ... 2024-04-25T13:27:24.496 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.dIyQnokYPa 2024-04-25T13:27:24.501 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:24.554 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:27:24.554 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T13:27:24.554 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:24.623 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T13:27:24.623 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2024-04-25T13:27:24.779 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:24.799 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:24.905 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub' 2024-04-25T13:27:24.907 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:24.909 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2024-04-25T13:27:24.922 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-04-25T13:27:24.949 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-04-25T13:27:24.949 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-04-25T13:27:24.950 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-04-25T13:27:24.950 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-04-25T13:27:24.950 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-04-25T13:27:24.950 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:24.950 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-04-25T13:27:24.950 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-04-25T13:27:24.950 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:24.950 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:24.951 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:24.951 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-04-25T13:27:24.951 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:24.951 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:24.951 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-04-25T13:27:24.951 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T13:27:24.951 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T13:27:24.951 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T13:27:24.952 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-04-25T13:27:24.952 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T13:27:24.952 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-04-25T13:27:25.014 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:27:25.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:27:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:25.093 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:27:25.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-04-25T13:27:25.166 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:25.171 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:25.237 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:25.243 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:25.294 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-25T13:27:25.294 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-25T13:27:25.329 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:25.334 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:25.365 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:27:25.365 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:27:25.374 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:25.379 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:25.394 INFO:teuthology.orchestra.run.smithi191.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:25.394 INFO:teuthology.orchestra.run.smithi191.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:25.394 INFO:teuthology.orchestra.run.smithi191.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:25.429 INFO:teuthology.orchestra.run.smithi191.stdout:done 2024-04-25T13:27:25.437 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:27:25.471 INFO:teuthology.orchestra.run.smithi097.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T13:27:25.472 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:27:25.472 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:27:25.472 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:27:25.472 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:27:25.473 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:27:25.473 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:27:25.473 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:27:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:25.513 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:27:25.515 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-04-25T13:27:25.516 INFO:teuthology.orchestra.run.smithi077.stderr:done 2024-04-25T13:27:25.518 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:27:25.527 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:25.528 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-04-25T13:27:25.529 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-04-25T13:27:25.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo shutdown -r now 2024-04-25T13:27:25.574 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.BoVv2Ld9Za 2024-04-25T13:27:25.574 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub/grub.cfg /tmp/tmp.BoVv2Ld9Za 2024-04-25T13:27:25.629 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.BoVv2Ld9Za 2024-04-25T13:27:25.760 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.BoVv2Ld9Za is 10KB 2024-04-25T13:27:25.773 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.BoVv2Ld9Za 2024-04-25T13:27:25.779 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:25.834 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:27:25.835 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T13:27:25.835 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:25.863 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2024-04-25T13:27:25.864 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:25.865 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-04-25T13:27:25.913 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T13:27:25.913 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-grub 2024-04-25T13:27:25.934 DEBUG:teuthology.orchestra.run.smithi191:> dpkg -s linux-image-generic 2024-04-25T13:27:25.957 INFO:teuthology.orchestra.run.smithi191.stdout:Package: linux-image-generic 2024-04-25T13:27:25.957 INFO:teuthology.orchestra.run.smithi191.stdout:Status: install ok installed 2024-04-25T13:27:25.957 INFO:teuthology.orchestra.run.smithi191.stdout:Priority: optional 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Section: kernel 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Installed-Size: 21 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: amd64 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Source: linux-meta 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Recommends: thermald 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:25.958 INFO:teuthology.orchestra.run.smithi191.stdout: available. 2024-04-25T13:27:25.959 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T13:27:25.959 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T13:27:25.959 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T13:27:25.959 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2024-04-25T13:27:25.959 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T13:27:25.959 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get clean 2024-04-25T13:27:26.108 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:26.115 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:26.148 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2024-04-25T13:27:26.273 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:27:26.287 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:27:26.307 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:27:26.397 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:26.402 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:26.409 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:27:26.446 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:26.451 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:26.582 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:26.582 INFO:teuthology.orchestra.run.smithi096.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:26.582 INFO:teuthology.orchestra.run.smithi096.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:26.595 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-04-25T13:27:26.604 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-04-25T13:27:26.703 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:27:26.720 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:27:26.772 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:27:26.948 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-04-25T13:27:26.949 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-04-25T13:27:27.080 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2024-04-25T13:27:27.081 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:27.084 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-04-25T13:27:27.104 INFO:teuthology.orchestra.run.smithi151.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T13:27:27.104 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:27:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:27:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:27:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:27:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:27:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:27:27.105 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:27:27.143 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:27:27.146 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-04-25T13:27:27.203 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-04-25T13:27:27.203 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-04-25T13:27:27.205 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-04-25T13:27:27.249 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.NSmeZXvvIF 2024-04-25T13:27:27.249 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NSmeZXvvIF 2024-04-25T13:27:27.269 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:27.275 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:27.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.NSmeZXvvIF 2024-04-25T13:27:27.427 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.NSmeZXvvIF is 10KB 2024-04-25T13:27:27.440 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.NSmeZXvvIF 2024-04-25T13:27:27.445 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:27.500 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:27:27.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T13:27:27.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:27.506 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:27.512 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:27.556 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:27.561 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:27.563 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T13:27:27.563 DEBUG:teuthology.orchestra.run.smithi151:> sudo update-grub 2024-04-25T13:27:27.690 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:27:27.705 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:27.705 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:27.705 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:27.708 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T13:27:27.719 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-04-25T13:27:27.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-04-25T13:27:27.769 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:27:27.970 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-25T13:27:27.970 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-25T13:27:28.150 INFO:teuthology.orchestra.run.smithi191.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T13:27:28.150 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:27:28.150 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:27:28.150 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:27:28.150 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:27:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:27:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:27:28.151 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:27:28.190 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T13:27:28.191 DEBUG:teuthology.orchestra.run.smithi191:> dpkg -s linux-image-generic 2024-04-25T13:27:28.207 INFO:teuthology.orchestra.run.smithi191.stdout:Package: linux-image-generic 2024-04-25T13:27:28.207 INFO:teuthology.orchestra.run.smithi191.stdout:Status: install ok installed 2024-04-25T13:27:28.207 INFO:teuthology.orchestra.run.smithi191.stdout:Priority: optional 2024-04-25T13:27:28.207 INFO:teuthology.orchestra.run.smithi191.stdout:Section: kernel 2024-04-25T13:27:28.207 INFO:teuthology.orchestra.run.smithi191.stdout:Installed-Size: 21 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: amd64 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout:Source: linux-meta 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout:Version: 5.15.0.105.102 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout:Recommends: thermald 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout:Description: Generic Linux kernel image 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: This package will always depend on the latest generic kernel image 2024-04-25T13:27:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: available. 2024-04-25T13:27:28.209 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-04-25T13:27:28.254 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.YDHkh8QSz1 2024-04-25T13:27:28.254 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub/grub.cfg /tmp/tmp.YDHkh8QSz1 2024-04-25T13:27:28.315 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.YDHkh8QSz1 2024-04-25T13:27:28.434 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.YDHkh8QSz1 is 10KB 2024-04-25T13:27:28.447 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.YDHkh8QSz1 2024-04-25T13:27:28.452 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:28.506 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:27:28.506 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T13:27:28.506 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T13:27:28.590 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T13:27:28.591 DEBUG:teuthology.orchestra.run.smithi191:> sudo update-grub 2024-04-25T13:27:28.849 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub' 2024-04-25T13:27:28.850 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:28.854 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-04-25T13:27:29.048 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:29.055 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:29.318 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:29.323 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:29.365 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:29.370 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:29.520 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:29.520 INFO:teuthology.orchestra.run.smithi151.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:29.520 INFO:teuthology.orchestra.run.smithi151.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:29.549 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-04-25T13:27:29.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-04-25T13:27:30.132 INFO:teuthology.orchestra.run.smithi191.stderr:Sourcing file `/etc/default/grub' 2024-04-25T13:27:30.133 INFO:teuthology.orchestra.run.smithi191.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:27:30.136 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2024-04-25T13:27:30.390 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T13:27:30.394 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T13:27:30.684 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:27:30.689 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:27:30.733 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:27:30.738 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:27:30.853 INFO:teuthology.orchestra.run.smithi191.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:27:30.853 INFO:teuthology.orchestra.run.smithi191.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:27:30.853 INFO:teuthology.orchestra.run.smithi191.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:27:30.880 INFO:teuthology.orchestra.run.smithi191.stderr:done 2024-04-25T13:27:30.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2024-04-25T13:27:55.558 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T13:27:55.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T13:27:55.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:27:56.607 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-25T13:27:56.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-25T13:27:56.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:27:57.742 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T13:27:57.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-25T13:27:57.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:27:59.556 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-25T13:27:59.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-04-25T13:27:59.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:00.926 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2024-04-25T13:28:00.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T13:28:00.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:14.114 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-04-25T13:28:15.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-25T13:28:16.158 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-25T13:28:17.954 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-04-25T13:28:19.486 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-25T13:28:23.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T13:28:23.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:24.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-25T13:28:24.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:25.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-25T13:28:25.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:26.174 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-04-25T13:28:26.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-04-25T13:28:26.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:27.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-25T13:28:28.222 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-25T13:28:28.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T13:28:28.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:30.018 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-04-25T13:28:31.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-25T13:28:38.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T13:28:38.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:39.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-25T13:28:39.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:40.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-25T13:28:40.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:42.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-04-25T13:28:42.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:43.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T13:28:43.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:28:56.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-04-25T13:28:57.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-25T13:28:58.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-25T13:29:01.982 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-25T13:29:11.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T13:29:11.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:11.819 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-04-25T13:29:12.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T13:29:12.596 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-25T13:29:12.596 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-04-25T13:29:12.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-25T13:29:12.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:12.647 INFO:teuthology.orchestra.run.smithi077.stdout:5.15.0-105-generic 2024-04-25T13:29:12.648 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T13:29:12.648 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T13:29:12.648 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T13:29:13.045 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-25T13:29:13.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-04-25T13:29:13.648 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T13:29:13.649 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:29:13.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-25T13:29:13.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:13.726 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2024-04-25T13:29:13.745 DEBUG:teuthology.parallel:result is None 2024-04-25T13:29:13.875 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-04-25T13:29:13.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-25T13:29:13.918 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-25T13:29:13.918 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-25T13:29:13.925 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-105-generic 2024-04-25T13:29:13.926 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T13:29:13.926 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T13:29:13.926 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T13:29:14.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-25T13:29:14.420 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.15.0-105-generic"... 2024-04-25T13:29:14.420 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-04-25T13:29:14.469 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-105-generic 2024-04-25T13:29:14.469 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T13:29:14.469 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T13:29:14.469 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T13:29:14.927 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T13:29:14.927 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:29:15.266 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-04-25T13:29:15.292 DEBUG:teuthology.parallel:result is None 2024-04-25T13:29:15.470 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-04-25T13:29:15.470 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:29:15.529 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-04-25T13:29:15.554 DEBUG:teuthology.parallel:result is None 2024-04-25T13:29:16.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T13:29:16.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:17.333 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-25T13:29:17.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T13:29:17.924 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.15.0-105-generic"... 2024-04-25T13:29:17.924 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-04-25T13:29:17.969 INFO:teuthology.orchestra.run.smithi191.stdout:5.15.0-105-generic 2024-04-25T13:29:17.969 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T13:29:17.970 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T13:29:17.970 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T13:29:18.970 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2024-04-25T13:29:18.970 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:29:19.336 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2024-04-25T13:29:19.371 DEBUG:teuthology.parallel:result is None 2024-04-25T13:29:28.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-04-25T13:29:28.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:28.732 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-04-25T13:29:29.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-04-25T13:29:29.340 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.15.0-105-generic"... 2024-04-25T13:29:29.341 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-04-25T13:29:29.389 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-105-generic 2024-04-25T13:29:29.389 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T13:29:29.389 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T13:29:29.389 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T13:29:30.390 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2024-04-25T13:29:30.390 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:29:30.474 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-04-25T13:29:30.506 DEBUG:teuthology.parallel:result is None 2024-04-25T13:29:30.507 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T13:29:30.514 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T13:29:30.514 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:29:30.517 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:29:30.519 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:29:30.522 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:29:30.525 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:29:30.531 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T13:29:30.537 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T13:29:30.543 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T13:29:30.544 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:29:30.564 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:29:30.567 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:29:30.569 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:29:30.574 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:29:30.668 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T13:29:30.675 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T13:29:30.675 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:29:30.678 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:29:30.680 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:29:30.682 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:29:30.685 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:29:30.704 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.705 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.706 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.709 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.711 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.712 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.714 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.714 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.718 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.719 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:29:30.721 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T13:29:30.729 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T13:29:30.729 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:29:30.764 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:29:30.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:29:30.769 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:29:30.772 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:29:30.785 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T13:29:30.794 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T13:29:30.795 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:29:30.820 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:29:30.831 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:29:30.833 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:29:30.836 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:29:30.842 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:29:30.871 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:29:30.920 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:29:30.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:29:30.986 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:29:30.992 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:29:31.038 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:29:31.039 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:29:31.103 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:29:31.109 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:29:31.156 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:29:31.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:29:31.217 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:29:31.223 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:29:31.270 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:29:31.270 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:29:31.338 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:29:31.344 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:29:31.393 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:29:31.393 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:29:31.460 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-04-25T13:29:31.462 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-04-25T13:29:31.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-04-25T13:29:31.467 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-04-25T13:29:31.470 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-04-25T13:29:31.531 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T13:29:31.539 INFO:teuthology.task.internal:Starting timer... 2024-04-25T13:29:31.539 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T13:29:31.548 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T13:29:31.556 DEBUG:teuthology.task.selinux:Excluding smithi077: OS 'ubuntu' does not support SELinux 2024-04-25T13:29:31.556 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2024-04-25T13:29:31.556 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2024-04-25T13:29:31.556 DEBUG:teuthology.task.selinux:Excluding smithi151: OS 'ubuntu' does not support SELinux 2024-04-25T13:29:31.556 DEBUG:teuthology.task.selinux:Excluding smithi191: OS 'ubuntu' does not support SELinux 2024-04-25T13:29:31.557 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T13:29:31.557 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T13:29:31.557 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T13:29:31.557 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T13:29:31.565 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T13:29:31.570 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T13:29:31.688 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T13:29:31.705 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T13:29:31.707 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi096.front.sepia.ceph.com,smithi097.front.sepia.ceph.com,smithi151.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T13:36:43.623 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-04-25T13:36:43.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T13:36:43.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:36:43.708 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-04-25T13:36:43.786 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T13:36:43.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-25T13:36:43.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:36:43.863 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-25T13:36:43.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-25T13:36:43.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-25T13:36:43.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:36:44.023 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-04-25T13:36:44.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-25T13:36:44.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-04-25T13:36:44.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:36:44.185 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-04-25T13:36:44.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-04-25T13:36:44.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T13:36:44.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:36:44.341 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-25T13:36:44.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T13:36:44.419 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T13:36:44.430 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T13:36:44.431 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:36:44.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:36:44.434 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:36:44.434 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:36:44.436 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:36:44.436 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:36:44.438 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:36:44.438 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:36:44.441 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:36:44.441 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:36:44.460 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T13:36:44.460 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: Command line: ntpd -gq 2024-04-25T13:36:44.460 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: ---------------------------------------------------- 2024-04-25T13:36:44.460 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T13:36:44.460 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T13:36:44.460 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: corporation. Support and training for ntp-4 are 2024-04-25T13:36:44.461 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: available at https://www.nwtime.org/support 2024-04-25T13:36:44.461 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: ---------------------------------------------------- 2024-04-25T13:36:44.462 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: proto: precision = 0.045 usec (-24) 2024-04-25T13:36:44.462 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: basedate set to 2022-02-04 2024-04-25T13:36:44.462 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: gps base set to 2022-02-06 (week 2196) 2024-04-25T13:36:44.462 INFO:teuthology.orchestra.run.smithi077.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.463 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.463 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.463 INFO:teuthology.orchestra.run.smithi077.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.464 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T13:36:44.464 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T13:36:44.465 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T13:36:44.465 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: Listen normally on 3 enp3s0f1 172.21.15.77:123 2024-04-25T13:36:44.465 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: Listen normally on 4 lo [::1]:123 2024-04-25T13:36:44.465 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3d3%5]:123 2024-04-25T13:36:44.465 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:44 ntpd[17199]: Listening on routing socket on fd #22 for interface updates 2024-04-25T13:36:44.466 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T13:36:44.466 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: Command line: ntpd -gq 2024-04-25T13:36:44.466 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: ---------------------------------------------------- 2024-04-25T13:36:44.466 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T13:36:44.467 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T13:36:44.467 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: corporation. Support and training for ntp-4 are 2024-04-25T13:36:44.467 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: available at https://www.nwtime.org/support 2024-04-25T13:36:44.467 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: ---------------------------------------------------- 2024-04-25T13:36:44.467 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: proto: precision = 0.060 usec (-24) 2024-04-25T13:36:44.467 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: basedate set to 2022-02-04 2024-04-25T13:36:44.467 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: gps base set to 2022-02-06 (week 2196) 2024-04-25T13:36:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.468 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.468 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.469 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T13:36:44.469 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T13:36:44.469 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T13:36:44.469 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2024-04-25T13:36:44.469 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: Listen normally on 4 lo [::1]:123 2024-04-25T13:36:44.469 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2024-04-25T13:36:44.470 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:44 ntpd[17200]: Listening on routing socket on fd #22 for interface updates 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: Command line: ntpd -gq 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: ---------------------------------------------------- 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: corporation. Support and training for ntp-4 are 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: available at https://www.nwtime.org/support 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: ---------------------------------------------------- 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: proto: precision = 0.045 usec (-24) 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: basedate set to 2022-02-04 2024-04-25T13:36:44.472 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: gps base set to 2022-02-06 (week 2196) 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi151.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: Command line: ntpd -gq 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: ---------------------------------------------------- 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: corporation. Support and training for ntp-4 are 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: available at https://www.nwtime.org/support 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: ---------------------------------------------------- 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: proto: precision = 0.045 usec (-24) 2024-04-25T13:36:44.473 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: basedate set to 2022-02-04 2024-04-25T13:36:44.474 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: gps base set to 2022-02-06 (week 2196) 2024-04-25T13:36:44.474 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.474 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.474 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.474 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.475 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.476 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.476 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: Listen normally on 4 lo [::1]:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:44 ntpd[17258]: Listening on routing socket on fd #22 for interface updates 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: Listen normally on 3 enp3s0f1 172.21.15.151:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: Listen normally on 4 lo [::1]:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f63%5]:123 2024-04-25T13:36:44.477 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:44 ntpd[17236]: Listening on routing socket on fd #22 for interface updates 2024-04-25T13:36:44.491 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T13:36:44.491 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: Command line: ntpd -gq 2024-04-25T13:36:44.492 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: ---------------------------------------------------- 2024-04-25T13:36:44.492 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T13:36:44.492 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T13:36:44.492 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: corporation. Support and training for ntp-4 are 2024-04-25T13:36:44.492 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: available at https://www.nwtime.org/support 2024-04-25T13:36:44.492 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: ---------------------------------------------------- 2024-04-25T13:36:44.492 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: proto: precision = 0.047 usec (-24) 2024-04-25T13:36:44.492 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: basedate set to 2022-02-04 2024-04-25T13:36:44.493 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: gps base set to 2022-02-06 (week 2196) 2024-04-25T13:36:44.493 INFO:teuthology.orchestra.run.smithi191.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.493 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:36:44.493 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.493 INFO:teuthology.orchestra.run.smithi191.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:36:44.494 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T13:36:44.495 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T13:36:44.495 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T13:36:44.495 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: Listen normally on 3 enp3s0f1 172.21.15.191:123 2024-04-25T13:36:44.495 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: Listen normally on 4 lo [::1]:123 2024-04-25T13:36:44.495 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7211%5]:123 2024-04-25T13:36:44.495 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:44 ntpd[17198]: Listening on routing socket on fd #22 for interface updates 2024-04-25T13:36:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:45 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:45 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:45 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:45 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:45 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:45.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:45 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:45.463 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:45 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.463 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:45 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.467 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:45 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:45 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:45 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:45 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:45 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:45 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:45 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:45.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:45 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:45.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:45.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:45.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:45.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:45 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:45.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:45 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:45 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:45 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:45 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:45 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:45.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:45 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:45.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:45 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:45.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:45 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:46.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:46 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:46 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:46 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:46 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:46 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:46.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:46 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:46.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:46.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.466 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.466 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:46.466 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:46 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:46.468 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:46 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.468 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:46 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:46 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:46 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:46 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:46 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:46 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:46.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:46 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:46.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:46 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:46 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:46 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:46.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:46 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:46.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:46 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:46.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:46 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:47 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:47 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:47 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:47 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:47 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:47 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:47 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:47 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:47 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:47 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:47 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:47.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:47 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:47.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:47 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:47.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:47 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:47 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:47 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:47.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:47 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:47.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:47 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:47.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:47 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:48 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:48.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:48.466 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:48 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:48 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:48 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:48 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:48 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:48 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:48 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:48.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:48.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:48 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:49.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:49 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:49 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:49 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:49 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:49 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:49 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:49 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:49.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:49 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:49.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:49.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:49.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:49 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:49.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.470 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:49.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:49.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:49.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:49 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:49.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:49 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:49 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:49 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:49.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:49 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:49.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:49 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:49.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:49 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:50.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:50.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:50 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:50.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:50 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:50.468 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:50 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.468 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:50 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.468 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:50 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:50 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:50 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:50 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:50.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:50.494 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:50 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:51.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:51 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:51 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:51 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:51 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:51 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:51.461 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:51 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:51.461 INFO:teuthology.orchestra.run.smithi077.stdout:25 Apr 13:36:51 ntpd[17199]: ntpd: time slew +0.000483 s 2024-04-25T13:36:51.462 INFO:teuthology.orchestra.run.smithi077.stdout:ntpd: time slew +0.000483s 2024-04-25T13:36:51.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:51 ntpd[17199]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T13:36:51.462 INFO:teuthology.orchestra.run.smithi077.stderr:25 Apr 13:36:51 ntpd[17199]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stdout:25 Apr 13:36:51 ntpd[17236]: ntpd: time slew -0.001014 s 2024-04-25T13:36:51.469 INFO:teuthology.orchestra.run.smithi151.stdout:ntpd: time slew -0.001014s 2024-04-25T13:36:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T13:36:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:25 Apr 13:36:51 ntpd[17236]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T13:36:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:51.472 INFO:teuthology.orchestra.run.smithi097.stdout:25 Apr 13:36:51 ntpd[17258]: ntpd: time slew -0.002777 s 2024-04-25T13:36:51.472 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew -0.002777s 2024-04-25T13:36:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T13:36:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:25 Apr 13:36:51 ntpd[17258]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T13:36:51.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:51 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:51 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:51 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:51.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:51 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:51.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:51 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:51.492 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:51 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:51.493 INFO:teuthology.orchestra.run.smithi191.stdout:25 Apr 13:36:51 ntpd[17198]: ntpd: time slew -0.004425 s 2024-04-25T13:36:51.493 INFO:teuthology.orchestra.run.smithi191.stdout:ntpd: time slew -0.004425s 2024-04-25T13:36:51.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:51 ntpd[17198]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T13:36:51.493 INFO:teuthology.orchestra.run.smithi191.stderr:25 Apr 13:36:51 ntpd[17198]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T13:36:51.520 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:36:51.520 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-04-25T13:36:51.520 INFO:teuthology.orchestra.run.smithi151.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.520 INFO:teuthology.orchestra.run.smithi151.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.521 INFO:teuthology.orchestra.run.smithi151.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.521 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.521 INFO:teuthology.orchestra.run.smithi077.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:36:51.522 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================== 2024-04-25T13:36:51.522 INFO:teuthology.orchestra.run.smithi077.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.522 INFO:teuthology.orchestra.run.smithi077.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.522 INFO:teuthology.orchestra.run.smithi077.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.522 INFO:teuthology.orchestra.run.smithi077.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.524 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:36:51.524 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-04-25T13:36:51.524 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.524 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.524 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.524 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.545 INFO:teuthology.orchestra.run.smithi191.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:36:51.546 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================== 2024-04-25T13:36:51.546 INFO:teuthology.orchestra.run.smithi191.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.546 INFO:teuthology.orchestra.run.smithi191.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.546 INFO:teuthology.orchestra.run.smithi191.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:51.546 INFO:teuthology.orchestra.run.smithi191.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:36:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:36:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:36:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:36:52.465 INFO:teuthology.orchestra.run.smithi096.stdout:25 Apr 13:36:52 ntpd[17200]: ntpd: time slew -0.001740 s 2024-04-25T13:36:52.465 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew -0.001740s 2024-04-25T13:36:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T13:36:52.465 INFO:teuthology.orchestra.run.smithi096.stderr:25 Apr 13:36:52 ntpd[17200]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T13:36:52.511 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:36:52.511 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-25T13:36:52.511 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:52.511 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:52.511 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:52.511 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:36:52.512 INFO:teuthology.run_tasks:Running task install... 2024-04-25T13:36:52.520 DEBUG:teuthology.task.install:project ceph 2024-04-25T13:36:52.521 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T13:36:52.521 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T13:36:52.521 INFO:teuthology.task.install:Using flavor: default 2024-04-25T13:36:52.527 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T13:36:52.527 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T13:36:52.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-key list | grep Ceph 2024-04-25T13:36:52.528 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2024-04-25T13:36:52.528 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2024-04-25T13:36:52.529 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-key list | grep Ceph 2024-04-25T13:36:52.529 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-key list | grep Ceph 2024-04-25T13:36:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T13:36:52.593 INFO:teuthology.orchestra.run.smithi191.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T13:36:52.595 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T13:36:52.596 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T13:36:52.613 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T13:36:52.614 INFO:teuthology.orchestra.run.smithi077.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T13:36:52.614 INFO:teuthology.orchestra.run.smithi077.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T13:36:52.615 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T13:36:52.615 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T13:36:52.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:36:52.623 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T13:36:52.623 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T13:36:52.624 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T13:36:52.624 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T13:36:52.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:36:52.627 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T13:36:52.627 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T13:36:52.627 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T13:36:52.627 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T13:36:52.628 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:36:52.631 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T13:36:52.631 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T13:36:52.632 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T13:36:52.632 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T13:36:52.632 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:36:52.640 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T13:36:52.640 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T13:36:52.641 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T13:36:52.641 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T13:36:52.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:36:52.802 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T13:36:52.802 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:52.835 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T13:36:52.835 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:52.844 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T13:36:52.844 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:52.849 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T13:36:52.849 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:52.852 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T13:36:52.852 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:53.136 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:36:53.136 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T13:36:53.150 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-25T13:36:53.171 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:36:53.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T13:36:53.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-get update 2024-04-25T13:36:53.187 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:36:53.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T13:36:53.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-04-25T13:36:53.246 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:36:53.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T13:36:53.249 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:36:53.249 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T13:36:53.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2024-04-25T13:36:53.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-04-25T13:36:53.321 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:36:53.332 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:36:53.351 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:36:53.351 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:36:53.353 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:36:53.364 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:36:53.376 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:36:53.376 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:36:53.384 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:36:53.390 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:36:53.411 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:36:53.433 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:36:53.433 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:36:53.435 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:36:53.436 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:36:53.446 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:36:53.466 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:36:53.550 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:36:53.556 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T13:36:53.606 INFO:teuthology.orchestra.run.smithi077.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T13:36:53.629 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T13:36:53.630 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T13:36:53.631 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:36:53.686 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T13:36:53.701 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T13:36:53.703 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T13:36:53.713 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:36:53.739 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T13:36:53.740 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T13:36:53.751 INFO:teuthology.orchestra.run.smithi077.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T13:36:53.767 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T13:36:53.767 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T13:36:53.817 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T13:36:53.819 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T13:36:53.820 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T13:36:53.832 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T13:36:53.843 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T13:36:53.893 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T13:36:53.897 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T13:36:53.898 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T13:36:53.909 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T13:36:53.938 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 29.2 kB in 1s (49.2 kB/s) 2024-04-25T13:36:53.979 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T13:36:53.980 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T13:36:53.981 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 29.2 kB in 1s (47.9 kB/s) 2024-04-25T13:36:53.996 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 29.2 kB in 1s (48.7 kB/s) 2024-04-25T13:36:54.066 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T13:36:54.069 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T13:36:54.156 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 29.2 kB in 1s (41.9 kB/s) 2024-04-25T13:36:54.164 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 29.2 kB in 1s (41.7 kB/s) 2024-04-25T13:36:54.932 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-25T13:36:54.949 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:54.959 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-04-25T13:36:54.973 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:36:54.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:54.988 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:55.010 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-25T13:36:55.036 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-04-25T13:36:55.040 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:36:55.137 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:36:55.153 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:55.159 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:36:55.174 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:36:55.210 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-25T13:36:55.211 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-25T13:36:55.214 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:36:55.220 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-04-25T13:36:55.221 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-04-25T13:36:55.236 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2024-04-25T13:36:55.236 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:36:55.237 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2024-04-25T13:36:55.393 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:36:55.393 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:36:55.393 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:36:55.393 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:36:55.394 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:36:55.394 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:36:55.394 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:36:55.394 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-04-25T13:36:55.394 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T13:36:55.395 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T13:36:55.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T13:36:55.397 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-04-25T13:36:55.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T13:36:55.398 INFO:teuthology.orchestra.run.smithi151.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T13:36:55.398 INFO:teuthology.orchestra.run.smithi151.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T13:36:55.398 INFO:teuthology.orchestra.run.smithi151.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T13:36:55.398 INFO:teuthology.orchestra.run.smithi151.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T13:36:55.398 INFO:teuthology.orchestra.run.smithi151.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T13:36:55.398 INFO:teuthology.orchestra.run.smithi151.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T13:36:55.398 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-04-25T13:36:55.398 INFO:teuthology.orchestra.run.smithi151.stdout: btrfs-tools 2024-04-25T13:36:55.399 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:36:55.399 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:36:55.399 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:36:55.400 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:36:55.400 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:36:55.400 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:36:55.400 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:36:55.401 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-25T13:36:55.401 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T13:36:55.401 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T13:36:55.401 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.401 INFO:teuthology.orchestra.run.smithi096.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T13:36:55.401 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T13:36:55.401 INFO:teuthology.orchestra.run.smithi096.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T13:36:55.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T13:36:55.403 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T13:36:55.403 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T13:36:55.403 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T13:36:55.403 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T13:36:55.403 INFO:teuthology.orchestra.run.smithi096.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T13:36:55.403 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-25T13:36:55.403 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T13:36:55.403 INFO:teuthology.orchestra.run.smithi096.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T13:36:55.403 INFO:teuthology.orchestra.run.smithi096.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T13:36:55.404 INFO:teuthology.orchestra.run.smithi096.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T13:36:55.404 INFO:teuthology.orchestra.run.smithi096.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T13:36:55.404 INFO:teuthology.orchestra.run.smithi096.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T13:36:55.404 INFO:teuthology.orchestra.run.smithi096.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T13:36:55.404 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-25T13:36:55.404 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2024-04-25T13:36:55.414 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-25T13:36:55.415 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-25T13:36:55.433 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:36:55.433 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:36:55.433 INFO:teuthology.orchestra.run.smithi077.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:36:55.433 INFO:teuthology.orchestra.run.smithi077.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:36:55.433 INFO:teuthology.orchestra.run.smithi077.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:36:55.433 INFO:teuthology.orchestra.run.smithi077.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:36:55.433 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:36:55.434 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2024-04-25T13:36:55.434 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T13:36:55.434 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T13:36:55.434 INFO:teuthology.orchestra.run.smithi077.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.435 INFO:teuthology.orchestra.run.smithi077.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T13:36:55.435 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T13:36:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T13:36:55.437 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T13:36:55.437 INFO:teuthology.orchestra.run.smithi077.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T13:36:55.437 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-25T13:36:55.437 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2024-04-25T13:36:55.437 INFO:teuthology.orchestra.run.smithi077.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T13:36:55.437 INFO:teuthology.orchestra.run.smithi077.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T13:36:55.437 INFO:teuthology.orchestra.run.smithi077.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T13:36:55.437 INFO:teuthology.orchestra.run.smithi077.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T13:36:55.438 INFO:teuthology.orchestra.run.smithi077.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T13:36:55.438 INFO:teuthology.orchestra.run.smithi077.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T13:36:55.438 INFO:teuthology.orchestra.run.smithi077.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T13:36:55.438 INFO:teuthology.orchestra.run.smithi077.stdout:Recommended packages: 2024-04-25T13:36:55.438 INFO:teuthology.orchestra.run.smithi077.stdout: btrfs-tools 2024-04-25T13:36:55.438 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-25T13:36:55.502 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-04-25T13:36:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T13:36:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T13:36:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T13:36:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T13:36:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T13:36:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T13:36:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T13:36:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T13:36:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T13:36:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T13:36:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T13:36:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: socat unzip xmlstarlet zip 2024-04-25T13:36:55.508 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-25T13:36:55.508 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T13:36:55.508 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T13:36:55.508 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T13:36:55.508 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T13:36:55.510 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.510 INFO:teuthology.orchestra.run.smithi096.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T13:36:55.510 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T13:36:55.510 INFO:teuthology.orchestra.run.smithi096.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T13:36:55.510 INFO:teuthology.orchestra.run.smithi096.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T13:36:55.510 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T13:36:55.510 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T13:36:55.511 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T13:36:55.512 INFO:teuthology.orchestra.run.smithi096.stdout: socat unzip xmlstarlet zip 2024-04-25T13:36:55.543 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2024-04-25T13:36:55.543 INFO:teuthology.orchestra.run.smithi077.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T13:36:55.543 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T13:36:55.544 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T13:36:55.545 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T13:36:55.545 INFO:teuthology.orchestra.run.smithi077.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.545 INFO:teuthology.orchestra.run.smithi077.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T13:36:55.545 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T13:36:55.545 INFO:teuthology.orchestra.run.smithi077.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T13:36:55.545 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T13:36:55.545 INFO:teuthology.orchestra.run.smithi077.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T13:36:55.546 INFO:teuthology.orchestra.run.smithi077.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T13:36:55.547 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T13:36:55.547 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T13:36:55.547 INFO:teuthology.orchestra.run.smithi077.stdout: socat unzip xmlstarlet zip 2024-04-25T13:36:55.608 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:36:55.608 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:36:55.608 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:36:55.608 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:36:55.608 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:36:55.609 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:36:55.609 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:36:55.609 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2024-04-25T13:36:55.609 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T13:36:55.609 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T13:36:55.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T13:36:55.612 INFO:teuthology.orchestra.run.smithi191.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout:Recommended packages: 2024-04-25T13:36:55.613 INFO:teuthology.orchestra.run.smithi191.stdout: btrfs-tools 2024-04-25T13:36:55.614 INFO:teuthology.orchestra.run.smithi077.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T13:36:55.614 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 175 MB of archives. 2024-04-25T13:36:55.614 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T13:36:55.614 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T13:36:55.626 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:36:55.626 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:36:55.626 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:36:55.626 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:36:55.626 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:36:55.627 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:36:55.627 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:36:55.627 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-04-25T13:36:55.628 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T13:36:55.628 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T13:36:55.628 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.628 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T13:36:55.629 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T13:36:55.630 INFO:teuthology.orchestra.run.smithi097.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T13:36:55.631 INFO:teuthology.orchestra.run.smithi097.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T13:36:55.631 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-04-25T13:36:55.631 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2024-04-25T13:36:55.636 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T13:36:55.647 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T13:36:55.693 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T13:36:55.693 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 175 MB of archives. 2024-04-25T13:36:55.693 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T13:36:55.693 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T13:36:55.698 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T13:36:55.699 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T13:36:55.699 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 175 MB of archives. 2024-04-25T13:36:55.699 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T13:36:55.699 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T13:36:55.719 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2024-04-25T13:36:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T13:36:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T13:36:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T13:36:55.719 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T13:36:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T13:36:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T13:36:55.720 INFO:teuthology.orchestra.run.smithi191.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T13:36:55.721 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T13:36:55.722 INFO:teuthology.orchestra.run.smithi191.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T13:36:55.722 INFO:teuthology.orchestra.run.smithi191.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T13:36:55.722 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T13:36:55.722 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T13:36:55.722 INFO:teuthology.orchestra.run.smithi191.stdout: socat unzip xmlstarlet zip 2024-04-25T13:36:55.723 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T13:36:55.727 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T13:36:55.734 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-25T13:36:55.734 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T13:36:55.734 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T13:36:55.734 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T13:36:55.734 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T13:36:55.736 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T13:36:55.737 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T13:36:55.737 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T13:36:55.737 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T13:36:55.737 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T13:36:55.737 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T13:36:55.737 INFO:teuthology.orchestra.run.smithi097.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T13:36:55.737 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T13:36:55.737 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T13:36:55.737 INFO:teuthology.orchestra.run.smithi097.stdout: socat unzip xmlstarlet zip 2024-04-25T13:36:55.740 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T13:36:55.775 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T13:36:55.781 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T13:36:55.798 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T13:36:55.798 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 175 MB of archives. 2024-04-25T13:36:55.798 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T13:36:55.798 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T13:36:55.799 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T13:36:55.802 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T13:36:55.814 INFO:teuthology.orchestra.run.smithi077.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T13:36:55.818 INFO:teuthology.orchestra.run.smithi077.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T13:36:55.819 INFO:teuthology.orchestra.run.smithi077.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T13:36:55.821 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T13:36:55.827 INFO:teuthology.orchestra.run.smithi077.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T13:36:55.828 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T13:36:55.829 INFO:teuthology.orchestra.run.smithi077.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T13:36:55.832 INFO:teuthology.orchestra.run.smithi077.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T13:36:55.832 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T13:36:55.832 INFO:teuthology.orchestra.run.smithi077.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T13:36:55.833 INFO:teuthology.orchestra.run.smithi077.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T13:36:55.840 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T13:36:55.854 INFO:teuthology.orchestra.run.smithi077.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T13:36:55.858 INFO:teuthology.orchestra.run.smithi077.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T13:36:55.859 INFO:teuthology.orchestra.run.smithi077.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T13:36:55.860 INFO:teuthology.orchestra.run.smithi077.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T13:36:55.860 INFO:teuthology.orchestra.run.smithi077.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T13:36:55.861 INFO:teuthology.orchestra.run.smithi077.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T13:36:55.861 INFO:teuthology.orchestra.run.smithi077.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T13:36:55.862 INFO:teuthology.orchestra.run.smithi077.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T13:36:55.862 INFO:teuthology.orchestra.run.smithi077.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T13:36:55.875 INFO:teuthology.orchestra.run.smithi077.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T13:36:55.883 INFO:teuthology.orchestra.run.smithi077.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T13:36:55.884 INFO:teuthology.orchestra.run.smithi077.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T13:36:55.887 INFO:teuthology.orchestra.run.smithi077.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T13:36:55.887 INFO:teuthology.orchestra.run.smithi077.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T13:36:55.887 INFO:teuthology.orchestra.run.smithi077.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T13:36:55.888 INFO:teuthology.orchestra.run.smithi077.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T13:36:55.889 INFO:teuthology.orchestra.run.smithi077.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T13:36:55.889 INFO:teuthology.orchestra.run.smithi077.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T13:36:55.896 INFO:teuthology.orchestra.run.smithi077.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T13:36:55.903 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T13:36:55.910 INFO:teuthology.orchestra.run.smithi077.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T13:36:55.911 INFO:teuthology.orchestra.run.smithi077.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T13:36:55.911 INFO:teuthology.orchestra.run.smithi077.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T13:36:55.917 INFO:teuthology.orchestra.run.smithi077.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T13:36:55.917 INFO:teuthology.orchestra.run.smithi077.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T13:36:55.917 INFO:teuthology.orchestra.run.smithi077.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T13:36:55.918 INFO:teuthology.orchestra.run.smithi077.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T13:36:55.920 INFO:teuthology.orchestra.run.smithi077.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T13:36:55.922 INFO:teuthology.orchestra.run.smithi077.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T13:36:55.923 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T13:36:55.923 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 175 MB of archives. 2024-04-25T13:36:55.923 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T13:36:55.923 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T13:36:55.931 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T13:36:55.934 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T13:36:55.940 INFO:teuthology.orchestra.run.smithi077.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T13:36:55.941 INFO:teuthology.orchestra.run.smithi077.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T13:36:55.942 INFO:teuthology.orchestra.run.smithi077.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T13:36:55.944 INFO:teuthology.orchestra.run.smithi077.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T13:36:55.945 INFO:teuthology.orchestra.run.smithi077.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T13:36:55.950 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T13:36:55.960 INFO:teuthology.orchestra.run.smithi077.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T13:36:55.962 INFO:teuthology.orchestra.run.smithi077.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T13:36:56.003 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T13:36:56.005 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T13:36:56.011 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T13:36:56.015 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T13:36:56.028 INFO:teuthology.orchestra.run.smithi077.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T13:36:56.030 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T13:36:56.031 INFO:teuthology.orchestra.run.smithi077.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T13:36:56.033 INFO:teuthology.orchestra.run.smithi077.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T13:36:56.033 INFO:teuthology.orchestra.run.smithi077.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T13:36:56.034 INFO:teuthology.orchestra.run.smithi077.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T13:36:56.043 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T13:36:56.049 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T13:36:56.050 INFO:teuthology.orchestra.run.smithi077.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T13:36:56.051 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T13:36:56.067 INFO:teuthology.orchestra.run.smithi191.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T13:36:56.067 INFO:teuthology.orchestra.run.smithi077.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T13:36:56.070 INFO:teuthology.orchestra.run.smithi077.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T13:36:56.070 INFO:teuthology.orchestra.run.smithi077.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T13:36:56.077 INFO:teuthology.orchestra.run.smithi191.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T13:36:56.077 INFO:teuthology.orchestra.run.smithi191.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T13:36:56.095 INFO:teuthology.orchestra.run.smithi191.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T13:36:56.099 INFO:teuthology.orchestra.run.smithi077.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T13:36:56.099 INFO:teuthology.orchestra.run.smithi077.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T13:36:56.099 INFO:teuthology.orchestra.run.smithi191.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T13:36:56.100 INFO:teuthology.orchestra.run.smithi077.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T13:36:56.101 INFO:teuthology.orchestra.run.smithi077.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T13:36:56.101 INFO:teuthology.orchestra.run.smithi077.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T13:36:56.102 INFO:teuthology.orchestra.run.smithi077.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T13:36:56.103 INFO:teuthology.orchestra.run.smithi191.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T13:36:56.105 INFO:teuthology.orchestra.run.smithi191.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T13:36:56.105 INFO:teuthology.orchestra.run.smithi191.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T13:36:56.112 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T13:36:56.114 INFO:teuthology.orchestra.run.smithi077.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T13:36:56.115 INFO:teuthology.orchestra.run.smithi077.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T13:36:56.119 INFO:teuthology.orchestra.run.smithi077.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T13:36:56.121 INFO:teuthology.orchestra.run.smithi191.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T13:36:56.124 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T13:36:56.125 INFO:teuthology.orchestra.run.smithi191.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T13:36:56.125 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T13:36:56.128 INFO:teuthology.orchestra.run.smithi191.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T13:36:56.129 INFO:teuthology.orchestra.run.smithi191.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T13:36:56.131 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T13:36:56.135 INFO:teuthology.orchestra.run.smithi077.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T13:36:56.137 INFO:teuthology.orchestra.run.smithi077.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T13:36:56.137 INFO:teuthology.orchestra.run.smithi077.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T13:36:56.138 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T13:36:56.142 INFO:teuthology.orchestra.run.smithi077.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T13:36:56.145 INFO:teuthology.orchestra.run.smithi077.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T13:36:56.145 INFO:teuthology.orchestra.run.smithi077.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T13:36:56.146 INFO:teuthology.orchestra.run.smithi077.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T13:36:56.147 INFO:teuthology.orchestra.run.smithi191.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T13:36:56.149 INFO:teuthology.orchestra.run.smithi191.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T13:36:56.149 INFO:teuthology.orchestra.run.smithi191.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T13:36:56.150 INFO:teuthology.orchestra.run.smithi191.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T13:36:56.150 INFO:teuthology.orchestra.run.smithi191.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T13:36:56.151 INFO:teuthology.orchestra.run.smithi191.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T13:36:56.156 INFO:teuthology.orchestra.run.smithi077.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T13:36:56.162 INFO:teuthology.orchestra.run.smithi077.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T13:36:56.162 INFO:teuthology.orchestra.run.smithi077.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T13:36:56.169 INFO:teuthology.orchestra.run.smithi191.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T13:36:56.170 INFO:teuthology.orchestra.run.smithi191.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T13:36:56.174 INFO:teuthology.orchestra.run.smithi191.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T13:36:56.175 INFO:teuthology.orchestra.run.smithi191.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T13:36:56.177 INFO:teuthology.orchestra.run.smithi077.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T13:36:56.177 INFO:teuthology.orchestra.run.smithi077.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T13:36:56.178 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T13:36:56.178 INFO:teuthology.orchestra.run.smithi077.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T13:36:56.178 INFO:teuthology.orchestra.run.smithi077.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T13:36:56.180 INFO:teuthology.orchestra.run.smithi077.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T13:36:56.181 INFO:teuthology.orchestra.run.smithi077.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T13:36:56.189 INFO:teuthology.orchestra.run.smithi077.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T13:36:56.190 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T13:36:56.193 INFO:teuthology.orchestra.run.smithi191.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T13:36:56.194 INFO:teuthology.orchestra.run.smithi191.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T13:36:56.195 INFO:teuthology.orchestra.run.smithi191.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T13:36:56.196 INFO:teuthology.orchestra.run.smithi191.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T13:36:56.196 INFO:teuthology.orchestra.run.smithi191.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T13:36:56.198 INFO:teuthology.orchestra.run.smithi191.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T13:36:56.199 INFO:teuthology.orchestra.run.smithi077.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T13:36:56.199 INFO:teuthology.orchestra.run.smithi077.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T13:36:56.202 INFO:teuthology.orchestra.run.smithi077.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T13:36:56.214 INFO:teuthology.orchestra.run.smithi191.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T13:36:56.214 INFO:teuthology.orchestra.run.smithi191.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T13:36:56.223 INFO:teuthology.orchestra.run.smithi191.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T13:36:56.223 INFO:teuthology.orchestra.run.smithi191.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T13:36:56.224 INFO:teuthology.orchestra.run.smithi077.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T13:36:56.247 INFO:teuthology.orchestra.run.smithi191.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T13:36:56.248 INFO:teuthology.orchestra.run.smithi191.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T13:36:56.250 INFO:teuthology.orchestra.run.smithi191.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T13:36:56.253 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T13:36:56.253 INFO:teuthology.orchestra.run.smithi191.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T13:36:56.254 INFO:teuthology.orchestra.run.smithi191.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T13:36:56.255 INFO:teuthology.orchestra.run.smithi191.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T13:36:56.257 INFO:teuthology.orchestra.run.smithi191.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T13:36:56.269 INFO:teuthology.orchestra.run.smithi191.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T13:36:56.272 INFO:teuthology.orchestra.run.smithi191.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T13:36:56.273 INFO:teuthology.orchestra.run.smithi191.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T13:36:56.275 INFO:teuthology.orchestra.run.smithi191.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T13:36:56.289 INFO:teuthology.orchestra.run.smithi191.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T13:36:56.347 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T13:36:56.351 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T13:36:56.360 INFO:teuthology.orchestra.run.smithi191.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T13:36:56.361 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T13:36:56.361 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T13:36:56.361 INFO:teuthology.orchestra.run.smithi191.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T13:36:56.363 INFO:teuthology.orchestra.run.smithi191.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T13:36:56.363 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T13:36:56.372 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T13:36:56.387 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T13:36:56.396 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T13:36:56.400 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T13:36:56.400 INFO:teuthology.orchestra.run.smithi191.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T13:36:56.401 INFO:teuthology.orchestra.run.smithi191.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T13:36:56.408 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T13:36:56.413 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T13:36:56.420 INFO:teuthology.orchestra.run.smithi191.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T13:36:56.422 INFO:teuthology.orchestra.run.smithi191.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T13:36:56.422 INFO:teuthology.orchestra.run.smithi191.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T13:36:56.439 INFO:teuthology.orchestra.run.smithi191.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T13:36:56.440 INFO:teuthology.orchestra.run.smithi191.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T13:36:56.440 INFO:teuthology.orchestra.run.smithi191.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T13:36:56.441 INFO:teuthology.orchestra.run.smithi191.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T13:36:56.441 INFO:teuthology.orchestra.run.smithi191.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T13:36:56.441 INFO:teuthology.orchestra.run.smithi191.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T13:36:56.454 INFO:teuthology.orchestra.run.smithi191.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T13:36:56.455 INFO:teuthology.orchestra.run.smithi191.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T13:36:56.459 INFO:teuthology.orchestra.run.smithi191.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T13:36:56.475 INFO:teuthology.orchestra.run.smithi191.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T13:36:56.477 INFO:teuthology.orchestra.run.smithi191.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T13:36:56.477 INFO:teuthology.orchestra.run.smithi191.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T13:36:56.481 INFO:teuthology.orchestra.run.smithi191.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T13:36:56.484 INFO:teuthology.orchestra.run.smithi191.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T13:36:56.484 INFO:teuthology.orchestra.run.smithi191.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T13:36:56.485 INFO:teuthology.orchestra.run.smithi191.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T13:36:56.495 INFO:teuthology.orchestra.run.smithi191.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T13:36:56.501 INFO:teuthology.orchestra.run.smithi191.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T13:36:56.502 INFO:teuthology.orchestra.run.smithi191.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T13:36:56.516 INFO:teuthology.orchestra.run.smithi191.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T13:36:56.516 INFO:teuthology.orchestra.run.smithi191.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T13:36:56.517 INFO:teuthology.orchestra.run.smithi191.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T13:36:56.517 INFO:teuthology.orchestra.run.smithi191.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T13:36:56.519 INFO:teuthology.orchestra.run.smithi191.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T13:36:56.520 INFO:teuthology.orchestra.run.smithi191.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T13:36:56.528 INFO:teuthology.orchestra.run.smithi191.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T13:36:56.536 INFO:teuthology.orchestra.run.smithi191.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T13:36:56.536 INFO:teuthology.orchestra.run.smithi191.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T13:36:56.539 INFO:teuthology.orchestra.run.smithi191.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T13:36:56.557 INFO:teuthology.orchestra.run.smithi191.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T13:36:56.562 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T13:36:56.573 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T13:36:56.586 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T13:36:56.595 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T13:36:56.623 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T13:36:56.631 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T13:36:56.795 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T13:36:57.135 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T13:36:57.146 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T13:36:57.150 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T13:36:57.161 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T13:36:57.165 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T13:36:57.174 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T13:36:57.174 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T13:36:57.176 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T13:36:57.185 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T13:36:57.185 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T13:36:57.191 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T13:36:57.202 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T13:36:57.229 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T13:36:57.240 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T13:36:57.242 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T13:36:57.246 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T13:36:57.246 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T13:36:57.253 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T13:36:57.257 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T13:36:57.257 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T13:36:57.279 INFO:teuthology.orchestra.run.smithi191.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T13:36:57.345 INFO:teuthology.orchestra.run.smithi077.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T13:36:57.368 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T13:36:57.383 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T13:36:57.399 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T13:36:57.408 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T13:36:57.409 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T13:36:57.417 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T13:36:57.425 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T13:36:57.428 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T13:36:57.462 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T13:36:57.476 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T13:36:57.480 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T13:36:57.480 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T13:36:57.500 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T13:36:57.512 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T13:36:57.519 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T13:36:57.523 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T13:36:57.581 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T13:36:57.594 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T13:36:57.620 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T13:36:57.624 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T13:36:57.635 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T13:36:57.646 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T13:36:57.651 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T13:36:57.653 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T13:36:57.674 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T13:36:57.734 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T13:36:57.742 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T13:36:57.755 INFO:teuthology.orchestra.run.smithi191.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T13:36:57.816 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T13:36:57.842 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T13:36:57.845 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T13:36:57.857 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T13:36:57.858 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T13:36:57.861 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T13:36:57.868 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T13:36:57.873 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T13:36:57.874 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T13:36:57.874 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T13:36:57.881 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T13:36:57.886 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T13:36:57.899 INFO:teuthology.orchestra.run.smithi191.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T13:36:57.916 INFO:teuthology.orchestra.run.smithi191.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T13:36:57.917 INFO:teuthology.orchestra.run.smithi191.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T13:36:57.925 INFO:teuthology.orchestra.run.smithi191.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T13:36:57.941 INFO:teuthology.orchestra.run.smithi191.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T13:36:57.972 INFO:teuthology.orchestra.run.smithi077.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T13:36:58.007 INFO:teuthology.orchestra.run.smithi191.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T13:36:58.056 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T13:36:58.064 INFO:teuthology.orchestra.run.smithi077.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T13:36:58.066 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T13:36:58.071 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T13:36:58.082 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T13:36:58.089 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T13:36:58.094 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T13:36:58.139 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T13:36:58.151 INFO:teuthology.orchestra.run.smithi077.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T13:36:58.154 INFO:teuthology.orchestra.run.smithi077.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T13:36:58.154 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T13:36:58.154 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T13:36:58.162 INFO:teuthology.orchestra.run.smithi077.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T13:36:58.166 INFO:teuthology.orchestra.run.smithi077.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T13:36:58.168 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T13:36:58.234 INFO:teuthology.orchestra.run.smithi077.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T13:36:58.278 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T13:36:58.295 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T13:36:58.337 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T13:36:58.348 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T13:36:58.361 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T13:36:58.377 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T13:36:58.388 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T13:36:58.393 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T13:36:58.402 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T13:36:58.406 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T13:36:58.552 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T13:36:58.560 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T13:36:58.560 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T13:36:58.562 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T13:36:58.566 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T13:36:58.569 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T13:36:58.569 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T13:36:58.570 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T13:36:58.574 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T13:36:58.579 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T13:36:58.585 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T13:36:58.593 INFO:teuthology.orchestra.run.smithi151.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T13:36:58.613 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T13:36:58.628 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T13:36:58.769 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T13:36:58.778 INFO:teuthology.orchestra.run.smithi151.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T13:36:58.786 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T13:36:58.786 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T13:36:58.792 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T13:36:58.797 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T13:36:58.811 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T13:36:58.997 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T13:36:59.032 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T13:36:59.041 INFO:teuthology.orchestra.run.smithi151.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T13:36:59.078 INFO:teuthology.orchestra.run.smithi191.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T13:36:59.137 INFO:teuthology.orchestra.run.smithi191.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T13:36:59.148 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T13:36:59.157 INFO:teuthology.orchestra.run.smithi151.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T13:36:59.160 INFO:teuthology.orchestra.run.smithi191.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T13:36:59.191 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T13:36:59.201 INFO:teuthology.orchestra.run.smithi151.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T13:36:59.261 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T13:36:59.274 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T13:36:59.277 INFO:teuthology.orchestra.run.smithi077.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T13:36:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T13:36:59.283 INFO:teuthology.orchestra.run.smithi151.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T13:36:59.285 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T13:36:59.297 INFO:teuthology.orchestra.run.smithi151.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T13:36:59.299 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T13:36:59.308 INFO:teuthology.orchestra.run.smithi151.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T13:36:59.338 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T13:36:59.348 INFO:teuthology.orchestra.run.smithi151.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T13:36:59.364 INFO:teuthology.orchestra.run.smithi077.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T13:36:59.376 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T13:36:59.393 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T13:36:59.420 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T13:36:59.502 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T13:36:59.514 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T13:36:59.527 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T13:36:59.566 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T13:36:59.600 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T13:36:59.602 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T13:36:59.605 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T13:36:59.608 INFO:teuthology.orchestra.run.smithi151.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T13:36:59.610 INFO:teuthology.orchestra.run.smithi151.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T13:36:59.612 INFO:teuthology.orchestra.run.smithi151.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T13:36:59.618 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T13:36:59.769 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T13:36:59.777 INFO:teuthology.orchestra.run.smithi151.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T13:36:59.790 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T13:36:59.792 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T13:36:59.830 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T13:36:59.832 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T13:36:59.835 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T13:36:59.879 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T13:36:59.882 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T13:36:59.978 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T13:36:59.998 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T13:37:00.106 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T13:37:00.116 INFO:teuthology.orchestra.run.smithi151.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T13:37:00.334 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T13:37:00.491 INFO:teuthology.orchestra.run.smithi151.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T13:37:00.500 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T13:37:00.511 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T13:37:00.512 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T13:37:00.512 INFO:teuthology.orchestra.run.smithi151.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T13:37:00.522 INFO:teuthology.orchestra.run.smithi151.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T13:37:00.523 INFO:teuthology.orchestra.run.smithi151.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T13:37:00.556 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T13:37:00.580 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T13:37:00.580 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T13:37:00.582 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T13:37:00.583 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T13:37:00.584 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T13:37:00.592 INFO:teuthology.orchestra.run.smithi151.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T13:37:00.592 INFO:teuthology.orchestra.run.smithi151.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T13:37:00.594 INFO:teuthology.orchestra.run.smithi151.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T13:37:00.595 INFO:teuthology.orchestra.run.smithi151.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T13:37:00.596 INFO:teuthology.orchestra.run.smithi151.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T13:37:00.727 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T13:37:00.737 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T13:37:00.738 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T13:37:00.750 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T13:37:00.761 INFO:teuthology.orchestra.run.smithi151.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T13:37:00.807 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T13:37:00.808 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T13:37:00.810 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T13:37:00.811 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T13:37:00.812 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T13:37:00.844 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T13:37:00.855 INFO:teuthology.orchestra.run.smithi151.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T13:37:00.916 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T13:37:00.941 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T13:37:00.952 INFO:teuthology.orchestra.run.smithi151.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T13:37:01.013 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T13:37:01.095 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T13:37:01.098 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T13:37:01.108 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T13:37:01.170 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T13:37:01.187 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T13:37:01.198 INFO:teuthology.orchestra.run.smithi151.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T13:37:01.204 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T13:37:01.220 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T13:37:01.230 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T13:37:01.240 INFO:teuthology.orchestra.run.smithi151.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T13:37:01.254 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T13:37:01.263 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T13:37:01.264 INFO:teuthology.orchestra.run.smithi151.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T13:37:01.273 INFO:teuthology.orchestra.run.smithi151.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T13:37:01.307 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T13:37:01.317 INFO:teuthology.orchestra.run.smithi151.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T13:37:01.332 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T13:37:01.333 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T13:37:01.340 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T13:37:01.342 INFO:teuthology.orchestra.run.smithi151.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T13:37:01.344 INFO:teuthology.orchestra.run.smithi151.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T13:37:01.346 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T13:37:01.350 INFO:teuthology.orchestra.run.smithi151.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T13:37:01.449 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T13:37:01.491 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T13:37:01.516 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T13:37:01.517 INFO:teuthology.orchestra.run.smithi151.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T13:37:01.524 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T13:37:01.537 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T13:37:01.568 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T13:37:01.593 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T13:37:01.595 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T13:37:01.602 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T13:37:01.768 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T13:37:01.967 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T13:37:02.036 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T13:37:02.055 INFO:teuthology.orchestra.run.smithi151.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T13:37:02.061 INFO:teuthology.orchestra.run.smithi151.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T13:37:02.073 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T13:37:02.079 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T13:37:02.100 INFO:teuthology.orchestra.run.smithi151.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T13:37:02.100 INFO:teuthology.orchestra.run.smithi151.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T13:37:02.107 INFO:teuthology.orchestra.run.smithi151.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T13:37:02.109 INFO:teuthology.orchestra.run.smithi151.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T13:37:02.118 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T13:37:02.119 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T13:37:02.125 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T13:37:02.126 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T13:37:02.127 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T13:37:02.150 INFO:teuthology.orchestra.run.smithi151.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T13:37:02.158 INFO:teuthology.orchestra.run.smithi151.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T13:37:02.168 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T13:37:02.177 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T13:37:02.232 INFO:teuthology.orchestra.run.smithi151.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T13:37:02.232 INFO:teuthology.orchestra.run.smithi151.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T13:37:02.249 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T13:37:02.250 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T13:37:02.306 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T13:37:02.312 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T13:37:02.352 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T13:37:02.352 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T13:37:02.359 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T13:37:02.361 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T13:37:02.397 INFO:teuthology.orchestra.run.smithi151.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T13:37:02.401 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T13:37:02.410 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T13:37:02.478 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T13:37:02.483 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T13:37:02.484 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T13:37:02.587 INFO:teuthology.orchestra.run.smithi077.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T13:37:02.666 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T13:37:02.836 INFO:teuthology.orchestra.run.smithi151.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T13:37:02.851 INFO:teuthology.orchestra.run.smithi151.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T13:37:02.922 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T13:37:02.937 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T13:37:03.058 INFO:teuthology.orchestra.run.smithi077.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T13:37:03.077 INFO:teuthology.orchestra.run.smithi191.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T13:37:03.085 INFO:teuthology.orchestra.run.smithi077.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T13:37:03.095 INFO:teuthology.orchestra.run.smithi077.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T13:37:03.107 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T13:37:03.122 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T13:37:03.265 INFO:teuthology.orchestra.run.smithi077.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T13:37:03.403 INFO:teuthology.orchestra.run.smithi151.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T13:37:03.763 INFO:teuthology.orchestra.run.smithi191.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T13:37:03.800 INFO:teuthology.orchestra.run.smithi191.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T13:37:03.805 INFO:teuthology.orchestra.run.smithi191.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T13:37:03.957 INFO:teuthology.orchestra.run.smithi077.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T13:37:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T13:37:04.059 INFO:teuthology.orchestra.run.smithi191.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T13:37:04.270 INFO:teuthology.orchestra.run.smithi151.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T13:37:04.278 INFO:teuthology.orchestra.run.smithi151.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T13:37:04.405 INFO:teuthology.orchestra.run.smithi151.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T13:37:04.449 INFO:teuthology.orchestra.run.smithi151.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T13:37:04.470 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T13:37:04.508 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T13:37:04.714 INFO:teuthology.orchestra.run.smithi151.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T13:37:04.721 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T13:37:04.988 INFO:teuthology.orchestra.run.smithi191.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T13:37:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T13:37:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T13:37:06.791 INFO:teuthology.orchestra.run.smithi077.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T13:37:07.133 INFO:teuthology.orchestra.run.smithi077.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T13:37:07.233 INFO:teuthology.orchestra.run.smithi077.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T13:37:07.274 INFO:teuthology.orchestra.run.smithi077.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T13:37:07.598 INFO:teuthology.orchestra.run.smithi077.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T13:37:08.892 INFO:teuthology.orchestra.run.smithi151.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T13:37:08.933 INFO:teuthology.orchestra.run.smithi151.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T13:37:09.141 INFO:teuthology.orchestra.run.smithi077.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T13:37:09.141 INFO:teuthology.orchestra.run.smithi077.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T13:37:09.202 INFO:teuthology.orchestra.run.smithi151.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T13:37:09.379 INFO:teuthology.orchestra.run.smithi191.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T13:37:09.379 INFO:teuthology.orchestra.run.smithi191.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T13:37:09.611 INFO:teuthology.orchestra.run.smithi191.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T13:37:10.134 INFO:teuthology.orchestra.run.smithi191.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T13:37:10.301 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T13:37:10.339 INFO:teuthology.orchestra.run.smithi191.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T13:37:10.361 INFO:teuthology.orchestra.run.smithi191.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T13:37:10.365 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T13:37:10.977 INFO:teuthology.orchestra.run.smithi191.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T13:37:11.011 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T13:37:11.035 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T13:37:11.058 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T13:37:11.282 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T13:37:12.154 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T13:37:12.368 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T13:37:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T13:37:12.529 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T13:37:13.259 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T13:37:13.335 INFO:teuthology.orchestra.run.smithi191.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T13:37:13.335 INFO:teuthology.orchestra.run.smithi191.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T13:37:15.168 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T13:37:15.169 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T13:37:15.243 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T13:37:15.561 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T13:37:15.683 INFO:teuthology.orchestra.run.smithi097.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T13:37:15.695 INFO:teuthology.orchestra.run.smithi097.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T13:37:15.922 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T13:37:16.005 INFO:teuthology.orchestra.run.smithi097.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T13:37:17.216 INFO:teuthology.orchestra.run.smithi097.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T13:37:17.217 INFO:teuthology.orchestra.run.smithi097.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T13:37:18.632 INFO:teuthology.orchestra.run.smithi077.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T13:37:18.634 INFO:teuthology.orchestra.run.smithi077.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T13:37:18.640 INFO:teuthology.orchestra.run.smithi077.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T13:37:18.641 INFO:teuthology.orchestra.run.smithi077.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T13:37:18.641 INFO:teuthology.orchestra.run.smithi077.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T13:37:18.642 INFO:teuthology.orchestra.run.smithi077.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T13:37:21.346 INFO:teuthology.orchestra.run.smithi151.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T13:37:22.889 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T13:37:22.890 INFO:teuthology.orchestra.run.smithi096.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T13:37:22.920 INFO:teuthology.orchestra.run.smithi077.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T13:37:23.031 INFO:teuthology.orchestra.run.smithi096.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T13:37:23.307 INFO:teuthology.orchestra.run.smithi151.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T13:37:23.389 INFO:teuthology.orchestra.run.smithi151.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T13:37:23.408 INFO:teuthology.orchestra.run.smithi151.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T13:37:23.529 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 175 MB in 27s (6,387 kB/s) 2024-04-25T13:37:23.593 INFO:teuthology.orchestra.run.smithi096.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T13:37:23.639 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T13:37:23.734 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T13:37:23.739 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T13:37:23.768 INFO:teuthology.orchestra.run.smithi096.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T13:37:23.778 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T13:37:23.782 INFO:teuthology.orchestra.run.smithi096.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T13:37:24.008 INFO:teuthology.orchestra.run.smithi151.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T13:37:24.073 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T13:37:24.080 INFO:teuthology.orchestra.run.smithi097.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T13:37:24.082 INFO:teuthology.orchestra.run.smithi097.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T13:37:24.087 INFO:teuthology.orchestra.run.smithi097.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T13:37:24.088 INFO:teuthology.orchestra.run.smithi097.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T13:37:24.089 INFO:teuthology.orchestra.run.smithi097.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T13:37:24.090 INFO:teuthology.orchestra.run.smithi097.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T13:37:24.099 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T13:37:24.139 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:37:24.268 INFO:teuthology.orchestra.run.smithi096.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T13:37:24.451 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T13:37:24.478 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T13:37:24.534 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T13:37:24.862 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T13:37:24.888 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T13:37:24.970 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:37:25.257 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T13:37:25.272 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T13:37:25.315 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:37:25.623 INFO:teuthology.orchestra.run.smithi097.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T13:37:25.652 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T13:37:25.678 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T13:37:25.718 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:37:26.089 INFO:teuthology.orchestra.run.smithi151.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T13:37:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T13:37:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T13:37:26.138 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T13:37:26.164 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:26.213 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:26.238 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 175 MB in 30s (5,850 kB/s) 2024-04-25T13:37:26.357 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T13:37:26.453 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T13:37:26.458 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T13:37:26.497 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T13:37:26.633 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T13:37:26.660 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:26.699 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:26.800 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T13:37:26.826 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T13:37:26.866 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:37:27.036 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T13:37:27.062 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:27.102 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:27.177 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T13:37:27.204 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T13:37:27.244 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T13:37:28.166 INFO:teuthology.orchestra.run.smithi191.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T13:37:28.168 INFO:teuthology.orchestra.run.smithi191.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T13:37:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T13:37:28.199 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T13:37:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:37:28.255 INFO:teuthology.orchestra.run.smithi191.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T13:37:28.256 INFO:teuthology.orchestra.run.smithi191.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T13:37:28.257 INFO:teuthology.orchestra.run.smithi191.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T13:37:28.258 INFO:teuthology.orchestra.run.smithi191.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T13:37:28.291 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T13:37:28.318 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T13:37:28.400 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:37:28.745 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T13:37:28.771 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T13:37:28.811 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:37:28.817 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librados2. 2024-04-25T13:37:28.843 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:28.884 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:29.181 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T13:37:29.207 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T13:37:29.247 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:37:29.378 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librbd1. 2024-04-25T13:37:29.404 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:29.445 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:29.634 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T13:37:29.661 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:29.872 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T13:37:29.888 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:29.930 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:30.070 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T13:37:30.097 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:30.137 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:30.225 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rados. 2024-04-25T13:37:30.251 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:30.291 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:30.336 INFO:teuthology.orchestra.run.smithi151.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T13:37:30.337 INFO:teuthology.orchestra.run.smithi151.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T13:37:30.414 INFO:teuthology.orchestra.run.smithi151.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T13:37:30.473 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T13:37:30.499 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:30.539 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:30.636 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T13:37:30.654 INFO:teuthology.orchestra.run.smithi191.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T13:37:30.662 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:30.710 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:30.775 INFO:teuthology.orchestra.run.smithi151.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T13:37:30.859 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T13:37:30.886 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T13:37:30.890 INFO:teuthology.orchestra.run.smithi151.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T13:37:30.894 INFO:teuthology.orchestra.run.smithi151.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T13:37:30.962 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:37:30.963 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T13:37:30.990 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:31.029 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:31.214 INFO:teuthology.orchestra.run.smithi151.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T13:37:31.272 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 175 MB in 35s (5,005 kB/s) 2024-04-25T13:37:31.282 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T13:37:31.297 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:31.362 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librados2. 2024-04-25T13:37:31.388 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:31.393 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T13:37:31.428 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:31.488 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T13:37:31.493 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T13:37:31.533 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T13:37:31.537 INFO:teuthology.orchestra.run.smithi096.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T13:37:31.540 INFO:teuthology.orchestra.run.smithi096.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T13:37:31.545 INFO:teuthology.orchestra.run.smithi096.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T13:37:31.546 INFO:teuthology.orchestra.run.smithi096.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T13:37:31.547 INFO:teuthology.orchestra.run.smithi096.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T13:37:31.548 INFO:teuthology.orchestra.run.smithi096.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T13:37:31.627 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T13:37:31.654 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T13:37:31.693 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T13:37:31.877 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T13:37:31.904 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T13:37:31.906 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librbd1. 2024-04-25T13:37:31.933 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:31.944 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:37:31.962 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T13:37:31.972 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:31.978 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:32.021 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:32.264 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T13:37:32.290 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T13:37:32.330 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T13:37:32.333 INFO:teuthology.orchestra.run.smithi151.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T13:37:32.342 INFO:teuthology.orchestra.run.smithi151.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T13:37:32.357 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T13:37:32.383 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T13:37:32.423 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:37:32.434 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T13:37:32.460 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:32.500 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:32.675 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T13:37:32.701 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T13:37:32.710 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T13:37:32.736 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T13:37:32.761 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2024-04-25T13:37:32.776 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:37:32.776 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:32.784 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:37:32.803 INFO:teuthology.orchestra.run.smithi096.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T13:37:32.811 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:33.087 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T13:37:33.113 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T13:37:33.138 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T13:37:33.153 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:37:33.165 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:33.205 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:33.246 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T13:37:33.272 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T13:37:33.304 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:37:33.421 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 175 MB in 37s (4,688 kB/s) 2024-04-25T13:37:33.449 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T13:37:33.456 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package lua5.1. 2024-04-25T13:37:33.465 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:33.472 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T13:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:37:33.507 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:33.558 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T13:37:33.640 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T13:37:33.641 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T13:37:33.646 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T13:37:33.667 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T13:37:33.699 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T13:37:33.707 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:37:33.801 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T13:37:33.828 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:33.868 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package lua-any. 2024-04-25T13:37:33.868 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:33.883 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T13:37:33.926 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T13:37:33.968 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T13:37:33.995 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T13:37:34.035 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:37:34.161 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T13:37:34.179 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package zip. 2024-04-25T13:37:34.187 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:34.204 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T13:37:34.205 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T13:37:34.231 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T13:37:34.235 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:34.245 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T13:37:34.271 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T13:37:34.337 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T13:37:34.364 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T13:37:34.404 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T13:37:34.506 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T13:37:34.533 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:34.565 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package unzip. 2024-04-25T13:37:34.582 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:34.591 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T13:37:34.597 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T13:37:34.624 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:34.631 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:37:34.664 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:34.732 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T13:37:34.758 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T13:37:34.840 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:37:34.926 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T13:37:34.953 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T13:37:34.993 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:37:34.994 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package luarocks. 2024-04-25T13:37:35.017 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T13:37:35.020 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T13:37:35.043 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:35.052 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:37:35.083 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:35.211 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T13:37:35.237 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T13:37:35.270 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T13:37:35.277 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:37:35.297 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T13:37:35.337 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:37:35.410 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librgw2. 2024-04-25T13:37:35.428 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T13:37:35.438 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:35.454 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T13:37:35.476 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:35.503 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:37:35.631 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T13:37:35.638 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T13:37:35.647 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T13:37:35.665 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T13:37:35.681 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:37:35.705 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:37:35.831 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librados2. 2024-04-25T13:37:35.858 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:35.890 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:35.993 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua5.1. 2024-04-25T13:37:36.020 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T13:37:36.059 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:37:36.103 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T13:37:36.119 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:36.158 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T13:37:36.161 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:36.185 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:36.233 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:36.368 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librbd1. 2024-04-25T13:37:36.370 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-any. 2024-04-25T13:37:36.393 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:36.397 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T13:37:36.434 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:36.437 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T13:37:36.506 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T13:37:36.532 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T13:37:36.572 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:37:36.620 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T13:37:36.646 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:36.686 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:36.689 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package zip. 2024-04-25T13:37:36.705 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T13:37:36.764 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T13:37:36.884 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T13:37:36.910 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:36.912 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T13:37:36.939 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:36.950 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:36.979 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:37.031 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T13:37:37.057 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:37.059 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package unzip. 2024-04-25T13:37:37.075 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T13:37:37.097 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:37.109 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:37:37.208 INFO:teuthology.orchestra.run.smithi151.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T13:37:37.210 INFO:teuthology.orchestra.run.smithi151.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T13:37:37.215 INFO:teuthology.orchestra.run.smithi151.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T13:37:37.216 INFO:teuthology.orchestra.run.smithi151.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T13:37:37.217 INFO:teuthology.orchestra.run.smithi151.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T13:37:37.218 INFO:teuthology.orchestra.run.smithi151.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T13:37:37.256 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rados. 2024-04-25T13:37:37.271 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:37.306 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:37.320 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-common. 2024-04-25T13:37:37.347 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:37.378 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:37.425 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T13:37:37.452 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T13:37:37.492 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:37:37.504 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package luarocks. 2024-04-25T13:37:37.531 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T13:37:37.571 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:37:37.584 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T13:37:37.610 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:37.650 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:37.828 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librados2. 2024-04-25T13:37:37.855 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:37.895 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:37.903 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T13:37:37.918 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:37.934 INFO:teuthology.orchestra.run.smithi151.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T13:37:37.945 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2024-04-25T13:37:37.961 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:37.972 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:38.012 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:38.415 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T13:37:38.441 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:38.481 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:38.548 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librbd1. 2024-04-25T13:37:38.574 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:38.614 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:38.620 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 175 MB in 42s (4,114 kB/s) 2024-04-25T13:37:38.647 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T13:37:38.663 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:38.706 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:38.762 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T13:37:38.801 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T13:37:38.827 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T13:37:38.858 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T13:37:38.864 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T13:37:38.867 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T13:37:38.902 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T13:37:39.000 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T13:37:39.025 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T13:37:39.058 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:37:39.092 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-base. 2024-04-25T13:37:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T13:37:39.103 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T13:37:39.119 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:39.119 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:39.119 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:39.162 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:39.169 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:39.206 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T13:37:39.225 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:39.232 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T13:37:39.272 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:37:39.361 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T13:37:39.388 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:39.428 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:39.511 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2024-04-25T13:37:39.526 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:39.532 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T13:37:39.558 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T13:37:39.569 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:39.576 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T13:37:39.598 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:37:39.602 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T13:37:39.634 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T13:37:39.763 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T13:37:39.789 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T13:37:39.829 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:37:39.848 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2024-04-25T13:37:39.874 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:39.884 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T13:37:39.910 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T13:37:39.914 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T13:37:39.914 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:39.940 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:39.950 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:37:39.979 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T13:37:39.980 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:40.006 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T13:37:40.088 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:37:40.157 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T13:37:40.183 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T13:37:40.207 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T13:37:40.223 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:37:40.234 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:40.256 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T13:37:40.266 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:40.271 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T13:37:40.314 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:37:40.417 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T13:37:40.444 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T13:37:40.484 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:37:40.552 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T13:37:40.578 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:40.593 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T13:37:40.618 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:40.620 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T13:37:40.652 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua5.1. 2024-04-25T13:37:40.668 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:37:40.678 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T13:37:40.718 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:37:40.805 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T13:37:40.831 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T13:37:40.871 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:37:40.938 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T13:37:40.964 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T13:37:41.005 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T13:37:41.022 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua-any. 2024-04-25T13:37:41.038 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T13:37:41.038 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T13:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T13:37:41.081 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T13:37:41.104 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:37:41.274 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T13:37:41.300 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:41.300 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T13:37:41.309 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package zip. 2024-04-25T13:37:41.327 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:41.335 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T13:37:41.340 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:41.368 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T13:37:41.386 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2024-04-25T13:37:41.400 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:41.407 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T13:37:41.412 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:41.433 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T13:37:41.462 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:41.473 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:37:41.660 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T13:37:41.671 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package unzip. 2024-04-25T13:37:41.686 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T13:37:41.699 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T13:37:41.727 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:37:41.738 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:37:41.760 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T13:37:41.786 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T13:37:41.821 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T13:37:41.826 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T13:37:41.848 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:41.888 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:41.963 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T13:37:41.989 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T13:37:42.020 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:37:42.048 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T13:37:42.075 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T13:37:42.115 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:37:42.118 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package luarocks. 2024-04-25T13:37:42.145 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T13:37:42.177 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:37:42.179 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-portend. 2024-04-25T13:37:42.206 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T13:37:42.242 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T13:37:42.254 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T13:37:42.268 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:37:42.308 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:37:42.315 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T13:37:42.341 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T13:37:42.382 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:37:42.418 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T13:37:42.444 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T13:37:42.484 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:37:42.553 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librgw2. 2024-04-25T13:37:42.580 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:42.582 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T13:37:42.608 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T13:37:42.620 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:42.648 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T13:37:42.662 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T13:37:42.688 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T13:37:42.735 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua5.1. 2024-04-25T13:37:42.737 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:37:42.761 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T13:37:42.787 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T13:37:42.801 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:37:42.814 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T13:37:42.845 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:37:42.993 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T13:37:43.020 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T13:37:43.049 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librados2. 2024-04-25T13:37:43.059 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:37:43.075 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:43.096 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-any. 2024-04-25T13:37:43.107 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:43.111 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T13:37:43.123 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T13:37:43.146 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T13:37:43.149 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T13:37:43.190 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:37:43.223 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T13:37:43.239 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:43.282 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:43.340 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package zip. 2024-04-25T13:37:43.355 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T13:37:43.398 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T13:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T13:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T13:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T13:37:43.501 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T13:37:43.528 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T13:37:43.568 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:37:43.727 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package unzip. 2024-04-25T13:37:43.736 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librbd1. 2024-04-25T13:37:43.753 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T13:37:43.761 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T13:37:43.763 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:43.782 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T13:37:43.787 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T13:37:43.802 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:43.809 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T13:37:43.818 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:37:43.827 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:37:43.849 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T13:37:43.870 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T13:37:43.897 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T13:37:43.937 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T13:37:44.111 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T13:37:44.126 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T13:37:44.139 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T13:37:44.160 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:37:44.166 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:44.206 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-portend. 2024-04-25T13:37:44.214 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:44.233 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T13:37:44.264 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T13:37:44.280 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package luarocks. 2024-04-25T13:37:44.289 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T13:37:44.306 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T13:37:44.316 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:44.355 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:37:44.356 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:44.430 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-mako. 2024-04-25T13:37:44.456 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T13:37:44.496 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:37:44.584 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T13:37:44.611 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T13:37:44.642 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rados. 2024-04-25T13:37:44.651 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T13:37:44.652 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-common. 2024-04-25T13:37:44.669 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:44.679 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:44.701 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:44.718 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:44.821 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2024-04-25T13:37:44.824 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T13:37:44.847 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:44.851 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T13:37:44.887 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:44.891 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:37:44.953 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T13:37:44.980 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T13:37:45.020 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:37:45.038 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T13:37:45.064 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:45.104 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:45.194 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T13:37:45.220 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T13:37:45.260 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:37:45.357 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T13:37:45.383 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T13:37:45.407 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T13:37:45.423 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T13:37:45.434 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:45.474 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:45.515 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T13:37:45.530 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:45.563 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-webob. 2024-04-25T13:37:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:45.589 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T13:37:45.629 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:37:45.760 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T13:37:45.761 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T13:37:45.787 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T13:37:45.787 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:45.819 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:45.826 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T13:37:45.960 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T13:37:45.986 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T13:37:46.016 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T13:37:46.034 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:37:46.042 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T13:37:46.086 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:37:46.112 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T13:37:46.123 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T13:37:46.139 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T13:37:46.149 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T13:37:46.179 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:37:46.190 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T13:37:46.217 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-base. 2024-04-25T13:37:46.244 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:46.285 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:46.395 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T13:37:46.404 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T13:37:46.422 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T13:37:46.430 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:46.451 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T13:37:46.462 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:37:46.466 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:46.479 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:46.510 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:46.682 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2024-04-25T13:37:46.708 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T13:37:46.748 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-paste. 2024-04-25T13:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T13:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:37:46.865 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T13:37:46.872 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T13:37:46.891 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T13:37:46.898 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T13:37:46.907 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2024-04-25T13:37:46.931 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:37:46.933 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:46.938 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:37:46.973 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:47.077 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T13:37:47.103 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T13:37:47.143 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:37:47.167 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T13:37:47.183 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T13:37:47.225 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T13:37:47.225 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:37:47.240 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T13:37:47.252 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T13:37:47.278 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T13:37:47.283 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:37:47.318 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:37:47.446 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T13:37:47.472 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T13:37:47.479 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T13:37:47.505 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T13:37:47.512 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:37:47.545 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:37:47.586 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T13:37:47.605 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T13:37:47.613 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T13:37:47.621 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T13:37:47.645 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:37:47.655 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:37:47.781 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2024-04-25T13:37:47.808 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T13:37:47.831 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T13:37:47.848 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T13:37:47.898 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T13:37:47.951 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T13:37:47.966 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua5.1. 2024-04-25T13:37:47.977 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T13:37:47.992 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T13:37:48.017 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:37:48.032 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:37:48.151 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T13:37:48.178 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T13:37:48.209 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T13:37:48.212 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:37:48.235 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T13:37:48.275 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:37:48.279 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T13:37:48.295 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T13:37:48.327 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-any. 2024-04-25T13:37:48.329 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:37:48.343 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T13:37:48.377 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T13:37:48.529 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T13:37:48.556 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T13:37:48.595 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:37:48.614 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package zip. 2024-04-25T13:37:48.641 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T13:37:48.681 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T13:37:48.755 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T13:37:48.782 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T13:37:48.821 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T13:37:48.829 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2024-04-25T13:37:48.855 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:48.881 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2024-04-25T13:37:48.908 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T13:37:48.913 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:48.948 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:37:48.975 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T13:37:49.001 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package unzip. 2024-04-25T13:37:49.001 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T13:37:49.028 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T13:37:49.041 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T13:37:49.076 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:37:49.191 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-idna. 2024-04-25T13:37:49.218 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T13:37:49.258 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T13:37:49.276 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T13:37:49.291 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T13:37:49.328 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-portend. 2024-04-25T13:37:49.334 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:37:49.355 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T13:37:49.395 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T13:37:49.422 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package luarocks. 2024-04-25T13:37:49.438 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T13:37:49.466 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T13:37:49.472 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:37:49.492 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T13:37:49.532 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:37:49.637 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T13:37:49.657 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T13:37:49.663 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T13:37:49.684 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T13:37:49.703 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:37:49.715 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T13:37:49.743 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T13:37:49.759 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T13:37:49.793 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:37:49.810 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T13:37:49.837 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T13:37:49.849 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librgw2. 2024-04-25T13:37:49.876 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:49.877 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:37:49.915 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:49.956 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T13:37:49.983 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T13:37:50.002 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T13:37:50.023 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T13:37:50.029 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T13:37:50.069 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:37:50.097 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-requests. 2024-04-25T13:37:50.112 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T13:37:50.146 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:37:50.197 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T13:37:50.224 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T13:37:50.263 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:37:50.342 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T13:37:50.369 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T13:37:50.409 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:37:50.441 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T13:37:50.458 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T13:37:50.467 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T13:37:50.484 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T13:37:50.507 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T13:37:50.524 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:37:50.566 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T13:37:50.568 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T13:37:50.584 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:50.592 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T13:37:50.618 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:50.632 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:37:50.763 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T13:37:50.778 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T13:37:50.790 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T13:37:50.804 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T13:37:50.827 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T13:37:50.830 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T13:37:50.836 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T13:37:50.843 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:50.877 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:50.893 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T13:37:50.920 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T13:37:50.952 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:37:50.972 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T13:37:50.999 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T13:37:51.039 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:37:51.149 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-idna. 2024-04-25T13:37:51.156 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T13:37:51.176 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T13:37:51.183 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T13:37:51.216 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T13:37:51.221 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T13:37:51.231 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:37:51.248 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T13:37:51.249 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T13:37:51.275 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:51.287 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T13:37:51.315 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:51.350 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T13:37:51.377 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:51.417 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:51.502 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T13:37:51.529 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T13:37:51.535 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-mako. 2024-04-25T13:37:51.562 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T13:37:51.569 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:37:51.590 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-portend. 2024-04-25T13:37:51.602 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:37:51.617 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T13:37:51.657 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T13:37:51.668 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T13:37:51.695 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T13:37:51.743 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:37:51.788 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-common. 2024-04-25T13:37:51.814 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:51.846 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:51.888 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests. 2024-04-25T13:37:51.889 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T13:37:51.915 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T13:37:51.916 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T13:37:51.947 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:37:51.955 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:37:51.982 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T13:37:52.009 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T13:37:52.051 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T13:37:52.112 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T13:37:52.139 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T13:37:52.179 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T13:37:52.251 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T13:37:52.274 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T13:37:52.278 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T13:37:52.301 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T13:37:52.318 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:37:52.329 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T13:37:52.341 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:37:52.356 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T13:37:52.396 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:37:52.515 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T13:37:52.542 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:52.582 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:52.596 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-webob. 2024-04-25T13:37:52.623 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T13:37:52.627 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T13:37:52.643 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:52.663 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:37:52.685 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:52.732 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T13:37:52.759 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T13:37:52.799 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T13:37:52.960 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T13:37:52.986 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:53.026 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:53.042 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T13:37:53.057 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T13:37:53.068 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T13:37:53.084 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:53.110 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T13:37:53.112 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:37:53.123 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:53.137 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T13:37:53.177 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T13:37:53.385 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T13:37:53.386 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-base. 2024-04-25T13:37:53.411 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T13:37:53.413 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:53.421 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T13:37:53.443 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:37:53.446 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T13:37:53.448 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T13:37:53.462 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T13:37:53.462 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:53.487 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:37:53.496 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:37:53.745 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T13:37:53.758 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-paste. 2024-04-25T13:37:53.764 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T13:37:53.772 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T13:37:53.784 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T13:37:53.790 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:53.812 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T13:37:53.825 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:37:53.838 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:53.907 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2024-04-25T13:37:53.934 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T13:37:53.974 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:37:54.140 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T13:37:54.162 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T13:37:54.167 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:54.189 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T13:37:54.206 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:54.229 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:37:54.241 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T13:37:54.268 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T13:37:54.294 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T13:37:54.308 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:37:54.320 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T13:37:54.361 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:37:54.516 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T13:37:54.542 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T13:37:54.553 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T13:37:54.579 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T13:37:54.582 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:37:54.601 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T13:37:54.619 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:37:54.628 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:54.668 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:54.713 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T13:37:54.739 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T13:37:54.788 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:37:54.878 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T13:37:54.904 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T13:37:54.936 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T13:37:54.948 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T13:37:54.975 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T13:37:55.015 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:37:55.133 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph. 2024-04-25T13:37:55.148 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:55.158 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2024-04-25T13:37:55.184 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T13:37:55.191 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:55.232 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T13:37:55.232 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:37:55.238 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T13:37:55.258 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T13:37:55.265 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:55.298 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:37:55.304 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:55.318 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T13:37:55.345 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T13:37:55.385 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:37:55.544 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T13:37:55.570 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:55.610 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:55.627 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T13:37:55.654 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T13:37:55.655 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T13:37:55.663 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T13:37:55.682 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T13:37:55.689 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T13:37:55.697 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:37:55.714 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:37:55.729 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T13:37:55.971 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T13:37:55.987 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T13:37:55.992 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T13:37:56.013 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T13:37:56.018 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T13:37:56.021 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:37:56.040 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:56.059 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T13:37:56.067 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-idna. 2024-04-25T13:37:56.088 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:56.093 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T13:37:56.133 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T13:37:56.308 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2024-04-25T13:37:56.334 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T13:37:56.349 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2024-04-25T13:37:56.362 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-portend. 2024-04-25T13:37:56.364 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:56.374 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:37:56.387 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T13:37:56.389 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T13:37:56.407 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:56.414 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T13:37:56.429 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T13:37:56.454 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:37:56.524 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephadm. 2024-04-25T13:37:56.551 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:56.591 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:56.691 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T13:37:56.702 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T13:37:56.717 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T13:37:56.726 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T13:37:56.729 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T13:37:56.753 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:56.757 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T13:37:56.766 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-requests. 2024-04-25T13:37:56.769 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:37:56.793 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T13:37:56.833 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:37:56.902 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T13:37:56.921 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:56.928 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T13:37:56.968 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T13:37:57.030 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T13:37:57.056 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T13:37:57.069 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T13:37:57.096 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T13:37:57.096 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:37:57.128 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T13:37:57.136 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:37:57.155 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T13:37:57.195 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:37:57.254 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T13:37:57.281 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:57.312 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T13:37:57.339 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:37:57.379 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:37:57.383 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T13:37:57.409 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T13:37:57.449 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T13:37:57.457 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T13:37:57.474 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T13:37:57.484 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T13:37:57.489 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:57.515 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T13:37:57.532 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:57.707 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2024-04-25T13:37:57.734 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:57.762 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T13:37:57.773 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:57.789 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T13:37:57.802 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T13:37:57.829 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:37:57.829 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T13:37:57.869 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T13:37:57.914 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T13:37:57.940 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:57.980 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:58.068 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T13:37:58.094 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T13:37:58.134 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T13:37:58.181 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T13:37:58.192 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T13:37:58.207 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T13:37:58.218 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T13:37:58.247 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:37:58.251 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T13:37:58.258 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T13:37:58.277 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T13:37:58.309 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:37:58.426 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-babel. 2024-04-25T13:37:58.445 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T13:37:58.453 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:37:58.461 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:37:58.492 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:37:58.503 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:37:58.526 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-mako. 2024-04-25T13:37:58.552 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T13:37:58.570 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-idna. 2024-04-25T13:37:58.584 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:37:58.596 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T13:37:58.613 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T13:37:58.636 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T13:37:58.639 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T13:37:58.704 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T13:37:58.812 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T13:37:58.838 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T13:37:58.855 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T13:37:58.878 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:37:58.881 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T13:37:58.913 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:37:59.139 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T13:37:59.165 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T13:37:59.208 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T13:37:59.214 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:37:59.231 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T13:37:59.235 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:59.242 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T13:37:59.258 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:37:59.268 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T13:37:59.275 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:59.298 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:59.308 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:37:59.525 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-babel. 2024-04-25T13:37:59.552 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:37:59.559 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests. 2024-04-25T13:37:59.585 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T13:37:59.591 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:37:59.603 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webob. 2024-04-25T13:37:59.629 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T13:37:59.633 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:37:59.634 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T13:37:59.646 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T13:37:59.661 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T13:37:59.670 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:37:59.672 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:37:59.701 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T13:37:59.712 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:37:59.911 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T13:37:59.938 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T13:37:59.970 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-routes. 2024-04-25T13:37:59.974 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T13:37:59.977 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:37:59.997 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T13:38:00.000 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T13:38:00.020 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T13:38:00.028 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:00.043 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:38:00.046 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T13:38:00.094 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:38:00.297 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T13:38:00.325 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T13:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:00.359 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T13:38:00.363 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:00.377 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T13:38:00.385 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:00.390 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:00.404 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T13:38:00.414 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T13:38:00.425 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:00.441 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:00.444 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:38:00.481 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:00.708 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T13:38:00.735 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T13:38:00.756 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-paste. 2024-04-25T13:38:00.775 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T13:38:00.783 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T13:38:00.844 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T13:38:00.848 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:38:00.870 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:00.911 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:01.028 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2024-04-25T13:38:01.043 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T13:38:01.077 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:01.177 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T13:38:01.192 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T13:38:01.205 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T13:38:01.232 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T13:38:01.235 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:38:01.271 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:38:01.363 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T13:38:01.379 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:01.413 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:01.487 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph. 2024-04-25T13:38:01.503 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:01.546 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:01.546 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T13:38:01.573 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T13:38:01.574 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T13:38:01.600 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T13:38:01.613 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:38:01.641 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T13:38:01.645 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T13:38:01.661 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T13:38:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:01.857 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T13:38:01.884 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:01.924 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:01.934 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T13:38:01.961 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T13:38:02.001 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T13:38:02.002 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T13:38:02.029 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:02.069 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:02.224 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T13:38:02.251 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T13:38:02.289 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:02.295 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T13:38:02.312 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T13:38:02.321 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:02.339 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T13:38:02.361 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:02.370 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:38:02.422 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T13:38:02.448 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:02.480 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:02.601 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T13:38:02.614 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T13:38:02.710 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T13:38:02.728 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:02.737 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T13:38:02.756 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package cephadm. 2024-04-25T13:38:02.768 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T13:38:02.772 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:02.785 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T13:38:02.801 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T13:38:02.806 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:02.835 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:03.031 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T13:38:03.058 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T13:38:03.083 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T13:38:03.088 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-idna. 2024-04-25T13:38:03.097 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:03.102 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T13:38:03.110 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:03.115 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T13:38:03.128 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T13:38:03.150 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:03.155 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T13:38:03.168 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T13:38:03.305 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T13:38:03.333 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T13:38:03.371 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:03.472 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T13:38:03.475 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T13:38:03.487 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:38:03.503 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T13:38:03.530 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:03.542 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:38:03.758 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T13:38:03.786 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T13:38:03.806 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T13:38:03.834 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:03.873 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:03.879 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests. 2024-04-25T13:38:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T13:38:03.910 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:38:04.188 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T13:38:04.215 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T13:38:04.228 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2024-04-25T13:38:04.241 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T13:38:04.255 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:04.255 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:04.268 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T13:38:04.308 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:38:04.453 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:04.629 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-babel. 2024-04-25T13:38:04.656 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:38:04.695 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:04.730 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T13:38:04.757 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:04.795 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T13:38:04.797 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:04.818 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T13:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T13:38:04.861 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:04.892 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:04.914 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T13:38:04.941 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:04.980 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:05.015 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T13:38:05.042 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T13:38:05.082 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:38:05.158 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T13:38:05.170 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T13:38:05.185 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:05.202 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T13:38:05.225 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:05.243 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T13:38:05.269 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:05.309 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:05.386 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:05.420 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T13:38:05.447 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:05.486 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:05.596 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T13:38:05.622 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T13:38:05.636 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2024-04-25T13:38:05.662 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:38:05.663 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:05.702 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:05.707 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T13:38:05.734 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T13:38:05.773 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:05.832 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T13:38:05.858 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T13:38:05.898 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T13:38:05.900 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T13:38:05.927 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T13:38:05.966 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:05.974 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T13:38:06.001 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T13:38:06.022 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T13:38:06.041 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T13:38:06.048 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T13:38:06.084 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T13:38:06.088 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T13:38:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T13:38:06.151 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T13:38:06.160 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-routes. 2024-04-25T13:38:06.176 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T13:38:06.210 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:06.221 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T13:38:06.248 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T13:38:06.287 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:06.353 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T13:38:06.380 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:06.407 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T13:38:06.420 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:06.423 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:38:06.463 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T13:38:06.465 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:06.490 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T13:38:06.514 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T13:38:06.529 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T13:38:06.541 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:06.581 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:06.599 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T13:38:06.626 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T13:38:06.665 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:06.807 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T13:38:06.832 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T13:38:06.833 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:06.848 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T13:38:06.873 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:06.882 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:38:06.977 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T13:38:07.004 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T13:38:07.043 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T13:38:07.144 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T13:38:07.171 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T13:38:07.201 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T13:38:07.347 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T13:38:07.374 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T13:38:07.413 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T13:38:07.487 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-babel. 2024-04-25T13:38:07.515 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:38:07.519 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T13:38:07.546 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:07.547 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T13:38:07.554 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:07.574 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T13:38:07.586 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:07.613 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:38:07.741 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T13:38:07.757 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T13:38:07.791 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:38:07.888 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T13:38:07.890 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T13:38:07.916 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T13:38:07.917 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T13:38:07.954 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:07.956 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:38:08.069 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T13:38:08.096 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T13:38:08.136 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T13:38:08.252 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T13:38:08.268 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:08.301 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T13:38:08.301 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:08.328 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:08.393 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:08.434 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T13:38:08.447 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T13:38:08.461 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T13:38:08.475 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T13:38:08.492 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:08.514 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:38:08.613 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T13:38:08.640 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T13:38:08.665 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph. 2024-04-25T13:38:08.679 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:08.680 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:08.721 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T13:38:08.725 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:08.748 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T13:38:08.779 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T13:38:08.831 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T13:38:08.857 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T13:38:08.992 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:09.016 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T13:38:09.043 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:09.045 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T13:38:09.048 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2024-04-25T13:38:09.071 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:09.076 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T13:38:09.082 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:09.111 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:09.115 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:09.211 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T13:38:09.227 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:09.260 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:09.304 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T13:38:09.331 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T13:38:09.343 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package jq. 2024-04-25T13:38:09.359 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:09.370 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:09.401 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:09.401 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T13:38:09.429 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:09.468 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:09.490 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T13:38:09.517 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:09.530 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T13:38:09.548 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:09.557 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T13:38:09.597 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:09.628 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package socat. 2024-04-25T13:38:09.644 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T13:38:09.678 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:09.924 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T13:38:09.940 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T13:38:09.952 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:09.956 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T13:38:09.989 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:09.991 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:10.058 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T13:38:10.085 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:10.111 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephadm. 2024-04-25T13:38:10.124 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:10.137 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:10.177 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:10.251 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2024-04-25T13:38:10.267 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:10.310 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:10.327 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-test. 2024-04-25T13:38:10.344 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:10.385 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:10.489 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T13:38:10.515 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T13:38:10.555 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T13:38:10.563 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2024-04-25T13:38:10.590 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T13:38:10.629 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:10.765 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T13:38:10.792 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T13:38:10.831 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:10.883 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T13:38:10.890 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T13:38:10.906 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T13:38:10.910 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:38:10.940 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:10.959 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:11.195 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T13:38:11.222 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T13:38:11.253 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2024-04-25T13:38:11.261 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:11.269 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:11.303 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:11.318 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T13:38:11.345 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T13:38:11.393 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:11.523 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T13:38:11.550 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T13:38:11.581 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:11.754 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T13:38:11.782 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T13:38:11.906 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:11.911 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T13:38:11.938 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T13:38:11.965 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-babel. 2024-04-25T13:38:11.977 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:11.992 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:38:12.031 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:12.184 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T13:38:12.211 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T13:38:12.250 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:12.282 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T13:38:12.309 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T13:38:12.348 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T13:38:12.368 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T13:38:12.395 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T13:38:12.435 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:38:12.648 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T13:38:12.670 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T13:38:12.675 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:12.697 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T13:38:12.714 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:12.736 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T13:38:12.763 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T13:38:12.790 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:12.830 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:12.968 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T13:38:12.995 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:13.034 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:13.049 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T13:38:13.076 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T13:38:13.093 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T13:38:13.107 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:38:13.121 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:13.159 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T13:38:13.160 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:13.187 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T13:38:13.226 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T13:38:13.394 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T13:38:13.422 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T13:38:13.461 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T13:38:13.479 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T13:38:13.506 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T13:38:13.529 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-routes. 2024-04-25T13:38:13.545 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T13:38:13.556 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T13:38:13.596 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:13.649 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T13:38:13.676 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:13.715 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:13.782 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T13:38:13.790 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T13:38:13.806 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:13.809 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T13:38:13.848 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:13.848 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:38:13.933 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T13:38:13.960 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:13.999 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:14.021 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T13:38:14.048 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T13:38:14.087 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:14.134 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T13:38:14.152 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:14.192 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:14.220 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T13:38:14.247 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:14.286 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:14.390 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T13:38:14.417 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T13:38:14.444 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T13:38:14.448 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:14.472 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:14.511 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:14.597 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T13:38:14.624 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T13:38:14.663 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T13:38:14.757 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T13:38:14.773 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:14.814 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:14.831 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T13:38:14.858 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T13:38:14.897 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:14.916 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T13:38:14.943 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:14.982 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:15.018 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T13:38:15.045 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T13:38:15.067 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T13:38:15.085 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:15.095 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T13:38:15.125 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:15.210 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T13:38:15.235 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T13:38:15.238 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T13:38:15.262 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:15.268 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:15.301 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:15.379 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T13:38:15.390 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T13:38:15.406 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T13:38:15.417 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T13:38:15.446 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T13:38:15.456 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:15.470 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T13:38:15.498 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:15.537 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:15.554 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T13:38:15.570 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:15.612 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:15.655 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T13:38:15.683 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T13:38:15.721 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:15.766 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T13:38:15.793 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T13:38:15.797 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package jq. 2024-04-25T13:38:15.813 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:15.832 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T13:38:15.855 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:15.932 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T13:38:15.959 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T13:38:15.985 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T13:38:15.998 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:16.013 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T13:38:16.052 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:16.083 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package socat. 2024-04-25T13:38:16.099 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T13:38:16.133 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:16.143 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package pkg-config. 2024-04-25T13:38:16.144 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T13:38:16.171 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T13:38:16.171 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T13:38:16.209 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:16.210 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:38:16.319 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T13:38:16.346 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T13:38:16.385 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:16.423 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T13:38:16.436 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T13:38:16.450 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T13:38:16.462 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T13:38:16.463 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T13:38:16.478 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T13:38:16.502 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:16.513 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T13:38:16.520 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:16.529 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T13:38:16.575 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:16.588 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T13:38:16.715 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T13:38:16.742 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T13:38:16.781 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:16.848 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-test. 2024-04-25T13:38:16.876 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:16.879 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T13:38:16.891 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T13:38:16.906 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:16.907 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T13:38:16.919 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T13:38:16.945 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:16.958 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:38:16.999 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T13:38:17.026 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T13:38:17.065 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:17.211 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pkg-config. 2024-04-25T13:38:17.238 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T13:38:17.277 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T13:38:17.362 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T13:38:17.401 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T13:38:17.497 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T13:38:17.510 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T13:38:17.538 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:17.622 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T13:38:17.638 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:17.646 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T13:38:17.673 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T13:38:17.680 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:17.698 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T13:38:17.704 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:17.727 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:17.765 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:17.933 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T13:38:17.961 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T13:38:17.966 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T13:38:17.993 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T13:38:17.999 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:18.007 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T13:38:18.024 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:18.035 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T13:38:18.073 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:18.302 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T13:38:18.330 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T13:38:18.369 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T13:38:18.369 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T13:38:18.396 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:18.426 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-py. 2024-04-25T13:38:18.436 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:18.454 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T13:38:18.492 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T13:38:18.681 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T13:38:18.696 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2024-04-25T13:38:18.708 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T13:38:18.719 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T13:38:18.724 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:18.738 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:18.746 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T13:38:18.763 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:18.785 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T13:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T13:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:19.015 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2024-04-25T13:38:19.025 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T13:38:19.031 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T13:38:19.052 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T13:38:19.073 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:19.089 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T13:38:19.091 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:19.116 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T13:38:19.155 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T13:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T13:38:19.358 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:19.377 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T13:38:19.385 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T13:38:19.394 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2024-04-25T13:38:19.404 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T13:38:19.413 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:19.422 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T13:38:19.443 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:19.452 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:19.460 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T13:38:19.510 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T13:38:19.537 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T13:38:19.576 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:19.669 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-toml. 2024-04-25T13:38:19.697 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T13:38:19.735 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T13:38:19.747 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T13:38:19.775 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T13:38:19.806 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2024-04-25T13:38:19.813 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:19.833 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:19.856 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T13:38:19.872 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:19.884 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:19.888 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T13:38:19.915 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T13:38:19.922 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:19.955 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T13:38:20.063 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T13:38:20.091 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T13:38:20.129 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:20.242 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T13:38:20.269 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T13:38:20.284 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T13:38:20.312 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T13:38:20.325 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T13:38:20.351 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:20.475 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T13:38:20.502 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T13:38:20.518 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T13:38:20.545 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T13:38:20.569 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T13:38:20.584 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T13:38:20.585 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:20.595 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:20.636 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:20.662 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-toml. 2024-04-25T13:38:20.689 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T13:38:20.728 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T13:38:20.880 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T13:38:20.896 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:20.905 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T13:38:20.930 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:20.932 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T13:38:20.972 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:38:21.018 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T13:38:21.031 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T13:38:21.034 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T13:38:21.047 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T13:38:21.077 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:21.089 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:21.157 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T13:38:21.185 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:21.223 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:21.259 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T13:38:21.274 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T13:38:21.309 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T13:38:21.434 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T13:38:21.462 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T13:38:21.500 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:21.543 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T13:38:21.570 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T13:38:21.604 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T13:38:21.609 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:21.632 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T13:38:21.671 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:38:21.778 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T13:38:21.794 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T13:38:21.836 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:21.847 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package radosgw. 2024-04-25T13:38:21.875 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:21.922 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:21.964 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T13:38:21.992 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T13:38:22.030 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:22.210 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T13:38:22.237 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:22.276 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:22.351 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T13:38:22.361 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T13:38:22.378 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T13:38:22.389 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:22.409 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:22.428 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:22.524 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2024-04-25T13:38:22.552 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:22.590 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:22.655 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T13:38:22.683 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:22.706 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T13:38:22.722 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:22.734 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T13:38:22.765 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:22.839 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package pkg-config. 2024-04-25T13:38:22.867 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T13:38:22.905 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:22.950 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T13:38:22.978 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:23.017 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:23.024 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T13:38:23.052 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T13:38:23.091 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T13:38:23.110 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T13:38:23.138 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:23.141 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T13:38:23.158 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T13:38:23.177 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:23.192 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:23.321 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:23.335 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T13:38:23.351 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:23.393 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:23.438 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package jq. 2024-04-25T13:38:23.466 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:38:23.505 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:23.543 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T13:38:23.559 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:23.580 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:38:23.593 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:23.611 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T13:38:23.639 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T13:38:23.662 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T13:38:23.669 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:23.678 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:23.689 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:23.721 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:23.733 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package socat. 2024-04-25T13:38:23.749 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T13:38:23.783 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:23.873 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:23.928 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T13:38:23.956 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T13:38:23.973 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T13:38:23.983 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T13:38:23.989 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:24.022 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T13:38:24.031 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:24.120 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T13:38:24.131 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:38:24.137 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T13:38:24.179 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:24.251 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T13:38:24.257 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:24.334 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T13:38:24.342 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T13:38:24.361 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T13:38:24.370 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T13:38:24.400 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:24.408 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:24.516 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T13:38:24.576 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-test. 2024-04-25T13:38:24.603 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:24.704 INFO:teuthology.orchestra.run.smithi077.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T13:38:24.705 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T13:38:24.719 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T13:38:24.729 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T13:38:24.747 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T13:38:24.779 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:24.786 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:24.792 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:24.832 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T13:38:25.131 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-py. 2024-04-25T13:38:25.159 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T13:38:25.197 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T13:38:25.238 INFO:teuthology.orchestra.run.smithi097.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T13:38:25.309 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:25.342 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T13:38:25.369 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T13:38:25.408 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:25.559 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T13:38:25.586 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T13:38:25.599 INFO:teuthology.orchestra.run.smithi077.stdout:Adding system user cephadm....done 2024-04-25T13:38:25.625 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:25.765 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:38:25.809 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2024-04-25T13:38:25.830 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package pkg-config. 2024-04-25T13:38:25.858 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T13:38:25.896 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:25.939 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:38:26.008 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:38:26.054 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T13:38:26.082 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T13:38:26.120 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:26.132 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T13:38:26.148 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T13:38:26.182 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:26.208 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:38:26.258 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:26.385 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:38:26.398 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-toml. 2024-04-25T13:38:26.426 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T13:38:26.464 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T13:38:26.467 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:26.568 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:38:26.594 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T13:38:26.622 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T13:38:26.636 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T13:38:26.660 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:26.776 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T13:38:26.803 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T13:38:26.836 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T13:38:26.841 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:26.887 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:38:26.930 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T13:38:26.957 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T13:38:26.996 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T13:38:27.006 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T13:38:27.013 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T13:38:27.033 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:27.072 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:27.129 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:38:27.154 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T13:38:27.170 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T13:38:27.212 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:27.230 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T13:38:27.315 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:27.316 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T13:38:27.344 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T13:38:27.382 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:27.411 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T13:38:27.438 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:27.464 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T13:38:27.469 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:27.481 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T13:38:27.522 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:27.523 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:27.650 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:27.702 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T13:38:27.729 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T13:38:27.769 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:27.798 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T13:38:27.825 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T13:38:27.864 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T13:38:27.892 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T13:38:28.114 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2024-04-25T13:38:28.125 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T13:38:28.141 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T13:38:28.141 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:28.143 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T13:38:28.144 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T13:38:28.179 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T13:38:28.184 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:28.235 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package radosgw. 2024-04-25T13:38:28.262 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:28.301 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:28.402 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T13:38:28.411 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:38:28.433 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T13:38:28.437 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T13:38:28.457 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T13:38:28.465 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:28.495 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:28.499 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:28.670 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:38:28.671 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:38:28.715 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T13:38:28.731 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:28.773 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:28.922 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:38:28.924 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:28.995 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T13:38:29.023 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T13:38:29.061 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:29.102 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T13:38:29.129 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T13:38:29.173 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:29.177 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:29.284 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:29.389 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-toml. 2024-04-25T13:38:29.404 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T13:38:29.417 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T13:38:29.432 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:29.432 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:29.456 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T13:38:29.470 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:29.524 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T13:38:29.535 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:29.551 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T13:38:29.590 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:29.683 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:29.758 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T13:38:29.775 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:29.786 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T13:38:29.803 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:29.825 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:29.920 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T13:38:29.928 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:29.934 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:29.948 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T13:38:29.987 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:30.025 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:38:30.043 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:30.054 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T13:38:30.151 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:30.162 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T13:38:30.169 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T13:38:30.189 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T13:38:30.228 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:30.322 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:38:30.377 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package pkg-config. 2024-04-25T13:38:30.404 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T13:38:30.418 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T13:38:30.429 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:38:30.431 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:38:30.434 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:30.497 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T13:38:30.525 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T13:38:30.555 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:38:30.564 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:30.663 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T13:38:30.674 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:38:30.679 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T13:38:30.721 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:30.751 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T13:38:30.847 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:38:31.055 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T13:38:31.089 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T13:38:31.152 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:38:31.159 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T13:38:31.168 INFO:teuthology.orchestra.run.smithi191.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T13:38:31.186 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T13:38:31.198 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T13:38:31.225 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:31.229 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T13:38:31.245 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:31.278 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:31.284 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:38:31.301 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2024-04-25T13:38:31.329 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:31.376 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:31.410 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:31.487 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T13:38:31.500 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T13:38:31.562 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T13:38:31.646 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:31.764 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T13:38:31.777 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:31.811 INFO:teuthology.orchestra.run.smithi191.stdout:Adding system user cephadm....done 2024-04-25T13:38:31.866 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T13:38:31.894 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T13:38:31.903 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T13:38:31.932 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:31.967 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:38:32.006 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:32.163 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:32.245 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T13:38:32.252 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:38:32.272 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T13:38:32.274 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:32.311 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:32.337 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T13:38:32.353 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:32.395 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:32.430 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:32.503 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:32.584 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T13:38:32.629 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:38:32.640 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-py. 2024-04-25T13:38:32.667 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T13:38:32.706 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T13:38:32.708 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:32.710 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:32.732 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T13:38:32.858 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:32.872 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T13:38:32.975 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:38:33.027 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T13:38:33.055 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T13:38:33.085 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:33.093 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:33.123 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:38:33.266 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T13:38:33.350 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T13:38:33.386 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:38:33.493 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:38:33.524 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T13:38:33.552 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T13:38:33.567 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:33.590 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:33.646 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:38:33.665 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T13:38:33.752 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:38:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:33.878 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:38:33.902 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-toml. 2024-04-25T13:38:33.927 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:33.929 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T13:38:33.968 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T13:38:34.013 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:38:34.064 INFO:teuthology.orchestra.run.smithi096.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T13:38:34.128 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:34.174 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T13:38:34.178 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T13:38:34.238 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T13:38:34.266 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T13:38:34.297 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T13:38:34.305 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:34.413 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T13:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T13:38:34.651 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T13:38:34.669 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2024-04-25T13:38:34.672 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:38:34.678 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T13:38:34.681 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T13:38:34.717 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:34.817 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:38:34.825 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:38:34.932 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:38:34.933 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:38:34.979 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T13:38:34.995 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T13:38:35.029 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:35.085 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:38:35.191 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:35.203 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:38:35.309 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:38:35.451 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:35.486 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:35.504 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T13:38:35.585 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T13:38:35.612 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:38:35.818 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package radosgw. 2024-04-25T13:38:35.819 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:35.830 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:38:35.846 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:35.863 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T13:38:35.884 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:35.894 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:38:36.078 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:36.123 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:38:36.179 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:36.229 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:38:36.254 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T13:38:36.256 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:38:36.297 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T13:38:36.472 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:36.491 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:36.548 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:38:36.567 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:36.598 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:36.600 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:36.665 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:38:36.863 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T13:38:36.879 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:36.891 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T13:38:36.893 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T13:38:36.902 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:36.916 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:38:36.921 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:37.162 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T13:38:37.200 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:37.210 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:37.218 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T13:38:37.282 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T13:38:37.339 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T13:38:37.403 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:38:37.421 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T13:38:37.469 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:38:37.504 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:37.604 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:38:37.697 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:38:37.847 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:37.872 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T13:38:37.940 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:38:37.947 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T13:38:38.200 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:38.207 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:38.234 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T13:38:38.347 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:38.453 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:38.483 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:38.599 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:38.634 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:38.663 INFO:teuthology.orchestra.run.smithi151.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T13:38:38.712 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:38.731 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:38.733 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T13:38:38.769 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T13:38:38.792 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T13:38:38.918 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:38.980 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:39.010 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:38:39.036 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:38:39.106 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:39.135 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:39.162 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:39.232 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T13:38:39.240 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user cephadm....done 2024-04-25T13:38:39.261 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:38:39.288 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:38:39.372 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:38:39.492 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:38:39.529 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:39.581 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:39.610 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:38:39.637 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:38:39.673 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:38:39.781 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T13:38:39.816 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T13:38:39.877 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:38:39.879 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:38:39.959 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:38:40.005 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:40.032 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:40.058 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:40.060 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:38:40.131 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:38:40.157 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:40.184 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:40.262 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T13:38:40.292 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T13:38:40.303 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T13:38:40.356 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:38:40.424 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T13:38:40.451 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:38:40.482 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:40.494 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:38:40.546 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:38:40.672 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T13:38:40.701 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T13:38:40.762 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T13:38:40.817 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T13:38:40.850 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:40.961 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T13:38:40.967 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T13:38:41.029 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T13:38:41.084 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:38:41.212 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:38:41.216 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:38:41.219 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:41.331 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:38:41.461 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:38:41.471 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T13:38:41.478 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:41.556 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T13:38:41.585 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T13:38:41.722 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:38:41.737 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T13:38:41.788 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T13:38:41.816 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:38:41.837 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T13:38:41.848 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T13:38:41.914 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:41.925 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T13:38:42.030 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:38:42.080 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T13:38:42.141 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:42.267 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:38:42.336 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:38:42.348 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:38:42.356 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:38:42.551 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:38:42.599 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:38:42.607 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:42.617 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:38:42.628 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:38:42.733 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:42.842 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:38:42.852 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:38:42.868 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:38:42.938 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:38:42.943 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:43.059 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T13:38:43.069 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:38:43.103 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:38:43.162 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:38:43.197 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:38:43.221 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:43.298 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:43.339 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:43.370 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T13:38:43.394 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:43.399 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:43.404 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:43.427 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T13:38:43.490 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T13:38:43.656 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:38:43.734 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:43.763 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T13:38:43.782 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:38:43.860 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:43.867 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:43.908 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T13:38:44.015 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:38:44.166 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:44.168 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:38:44.245 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:38:44.294 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:38:44.383 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:38:44.504 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T13:38:44.524 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:44.535 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:38:44.571 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:38:44.630 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T13:38:44.651 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T13:38:44.785 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T13:38:44.793 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:44.881 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:44.912 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T13:38:44.919 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T13:38:44.952 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:38:44.963 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T13:38:44.990 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:38:44.994 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T13:38:45.050 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:38:45.159 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T13:38:45.170 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:38:45.171 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:45.271 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:45.280 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:38:45.295 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:38:45.300 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:45.372 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:38:45.519 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:45.563 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:45.584 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:38:45.590 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:45.629 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T13:38:45.648 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:45.689 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:45.860 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:45.889 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:38:45.899 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:38:46.007 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T13:38:46.072 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T13:38:46.141 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T13:38:46.157 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:38:46.192 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:46.325 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:46.339 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T13:38:46.395 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T13:38:46.400 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:46.450 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T13:38:46.526 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:46.551 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:38:46.599 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:38:46.663 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T13:38:46.834 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:38:46.836 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:38:46.939 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:38:47.079 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T13:38:47.198 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:38:47.210 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T13:38:47.237 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:38:47.313 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T13:38:47.495 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:38:47.505 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:38:47.531 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:47.555 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:38:47.575 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T13:38:47.631 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:38:47.758 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:38:47.766 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:47.798 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T13:38:47.847 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:38:47.851 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:38:47.900 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T13:38:47.957 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:48.059 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T13:38:48.066 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:38:48.066 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:48.160 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:38:48.176 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:38:48.179 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:38:48.192 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T13:38:48.286 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:48.288 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:48.412 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:38:48.414 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:48.452 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T13:38:48.476 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:48.512 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:48.541 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:38:48.611 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:38:48.654 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:48.697 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:38:48.714 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:48.780 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T13:38:48.876 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:48.887 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:38:48.965 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T13:38:49.002 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:49.057 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:49.082 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:38:49.128 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T13:38:49.174 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:49.197 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:38:49.207 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:49.309 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:49.334 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:49.374 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T13:38:49.413 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:49.447 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:38:49.520 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:38:49.520 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:38:49.539 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:49.573 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:49.635 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:38:49.665 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:49.692 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:38:49.699 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:49.787 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T13:38:49.876 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:38:49.876 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:38:49.886 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T13:38:49.985 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:50.010 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:38:50.017 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:50.111 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:50.143 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:50.171 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T13:38:50.237 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:50.261 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:38:50.363 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:50.366 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:50.387 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:50.431 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:38:50.476 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:50.503 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:38:50.520 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:38:50.593 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:50.682 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T13:38:50.689 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T13:38:50.719 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:50.754 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T13:38:50.845 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:38:50.880 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T13:38:50.941 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:38:51.014 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:38:51.067 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T13:38:51.139 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:51.265 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:38:51.352 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:51.478 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:38:51.575 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:51.779 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:38:51.884 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:38:51.885 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.001 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.014 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.089 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:38:52.127 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.137 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:38:52.137 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.169 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:52.253 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.263 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.348 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:38:52.370 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.380 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T13:38:52.380 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:52.389 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.474 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:52.480 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.514 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T13:38:52.583 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:52.597 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:52.657 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T13:38:52.664 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T13:38:52.782 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:38:52.881 INFO:teuthology.orchestra.run.smithi077.stdout:Adding group ceph....done 2024-04-25T13:38:52.899 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:38:52.910 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:52.940 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:38:53.000 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:38:53.036 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:53.140 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2024-04-25T13:38:53.200 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:38:53.249 INFO:teuthology.orchestra.run.smithi077.stdout:Adding system user ceph....done 2024-04-25T13:38:53.293 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:38:53.368 INFO:teuthology.orchestra.run.smithi077.stdout:Setting system user ceph properties....done 2024-04-25T13:38:53.386 INFO:teuthology.orchestra.run.smithi077.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T13:38:53.438 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:38:53.467 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2024-04-25T13:38:53.520 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T13:38:53.544 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T13:38:53.577 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T13:38:53.660 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2024-04-25T13:38:53.680 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T13:38:53.705 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T13:38:53.787 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:53.819 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T13:38:53.832 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T13:38:53.838 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T13:38:53.870 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:38:53.905 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:38:54.099 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:54.162 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T13:38:54.180 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:38:54.206 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:38:54.225 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:38:54.307 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:54.348 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:54.433 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:54.457 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T13:38:54.524 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:38:54.524 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:38:54.558 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:38:54.569 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:54.624 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:54.733 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T13:38:54.832 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:38:54.832 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:38:54.862 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:38:54.895 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:38:54.991 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:54.996 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:55.097 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T13:38:55.117 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:55.146 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:55.235 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T13:38:55.292 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:55.357 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:55.357 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T13:38:55.410 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:55.483 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:55.511 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:38:55.607 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:38:55.607 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:38:55.609 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:55.612 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T13:38:55.625 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T13:38:55.843 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:38:55.843 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:38:55.866 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:38:55.866 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:38:55.888 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:38:55.919 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:38:56.014 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:38:56.077 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:56.170 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:38:56.278 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:56.315 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:38:56.318 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:56.428 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T13:38:56.436 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:56.537 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:56.555 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T13:38:56.608 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:38:56.638 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:56.638 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T13:38:56.755 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:38:56.840 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:38:56.850 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:38:56.929 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:56.976 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:38:57.098 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:57.102 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:38:57.158 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:38:57.159 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:38:57.167 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:38:57.208 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T13:38:57.288 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:38:57.288 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:38:57.302 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:57.428 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:57.437 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:38:57.572 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:38:57.579 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:38:57.672 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:57.741 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:57.867 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:38:57.867 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:38:57.915 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:57.954 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:38:57.954 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:38:57.965 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:38:57.967 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.025 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.093 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.126 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T13:38:58.224 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T13:38:58.227 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.333 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T13:38:58.337 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.357 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.411 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.417 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.437 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.537 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.538 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.576 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:58.615 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:38:58.615 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:38:58.680 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:58.694 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:38:58.695 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:38:58.735 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:38:58.888 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:38:58.888 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:38:59.053 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:38:59.055 INFO:teuthology.orchestra.run.smithi191.stdout:Adding group ceph....done 2024-04-25T13:38:59.109 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.177 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.235 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.295 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.345 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:38:59.347 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.386 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.399 INFO:teuthology.orchestra.run.smithi191.stdout:Adding system user ceph....done 2024-04-25T13:38:59.429 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.474 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.551 INFO:teuthology.orchestra.run.smithi191.stdout:Setting system user ceph properties....done 2024-04-25T13:38:59.564 INFO:teuthology.orchestra.run.smithi191.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T13:38:59.583 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.610 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:38:59.610 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:38:59.639 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T13:38:59.684 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.706 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T13:38:59.810 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:38:59.834 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:38:59.834 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:38:59.858 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T13:39:00.066 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T13:39:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.126 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T13:39:00.230 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.347 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.359 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.394 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:39:00.473 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.510 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.531 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.636 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.653 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:39:00.747 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:39:00.747 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:39:00.787 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.809 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:39:00.910 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:39:00.972 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.038 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T13:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:39:01.082 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.148 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:39:01.209 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.241 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:39:01.274 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.334 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.340 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:39:01.400 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.426 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:39:01.569 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.667 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:39:01.711 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.793 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.864 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:39:01.865 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:39:01.919 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:02.037 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:39:02.222 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:39:02.238 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2024-04-25T13:39:02.318 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:02.356 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:02.503 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:02.544 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:39:02.623 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2024-04-25T13:39:02.633 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T13:39:02.671 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T13:39:02.783 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2024-04-25T13:39:02.797 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T13:39:02.884 INFO:teuthology.orchestra.run.smithi077.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:39:02.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T13:39:02.901 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:02.931 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T13:39:02.941 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-04-25T13:39:03.027 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.120 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.142 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2024-04-25T13:39:03.143 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2024-04-25T13:39:03.153 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.173 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:39:03.176 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T13:39:03.232 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T13:39:03.232 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:39:03.330 INFO:teuthology.orchestra.run.smithi077.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T13:39:03.330 INFO:teuthology.orchestra.run.smithi077.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T13:39:03.330 INFO:teuthology.orchestra.run.smithi077.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T13:39:03.330 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:39:03.330 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:39:03.330 INFO:teuthology.orchestra.run.smithi077.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:39:03.330 INFO:teuthology.orchestra.run.smithi077.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:39:03.330 INFO:teuthology.orchestra.run.smithi077.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:39:03.331 INFO:teuthology.orchestra.run.smithi077.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:39:03.331 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:39:03.331 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2024-04-25T13:39:03.331 INFO:teuthology.orchestra.run.smithi077.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T13:39:03.332 INFO:teuthology.orchestra.run.smithi077.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T13:39:03.332 INFO:teuthology.orchestra.run.smithi077.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T13:39:03.332 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T13:39:03.332 INFO:teuthology.orchestra.run.smithi077.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:03.333 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2024-04-25T13:39:03.333 INFO:teuthology.orchestra.run.smithi077.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T13:39:03.333 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T13:39:03.333 INFO:teuthology.orchestra.run.smithi077.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T13:39:03.358 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:39:03.358 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:39:03.370 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:39:03.370 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:39:03.372 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2024-04-25T13:39:03.373 INFO:teuthology.orchestra.run.smithi077.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T13:39:03.373 INFO:teuthology.orchestra.run.smithi077.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T13:39:03.374 INFO:teuthology.orchestra.run.smithi077.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T13:39:03.374 INFO:teuthology.orchestra.run.smithi077.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T13:39:03.374 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T13:39:03.374 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T13:39:03.374 INFO:teuthology.orchestra.run.smithi077.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:03.375 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages will be upgraded: 2024-04-25T13:39:03.375 INFO:teuthology.orchestra.run.smithi077.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T13:39:03.433 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-25T13:39:03.434 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-25T13:39:03.436 INFO:teuthology.orchestra.run.smithi077.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:39:03.436 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 55.7 MB of archives. 2024-04-25T13:39:03.436 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T13:39:03.436 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T13:39:03.596 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T13:39:03.603 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T13:39:03.623 INFO:teuthology.orchestra.run.smithi097.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T13:39:03.623 INFO:teuthology.orchestra.run.smithi097.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T13:39:03.623 INFO:teuthology.orchestra.run.smithi097.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T13:39:03.623 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:39:03.624 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:39:03.624 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:39:03.624 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:39:03.624 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:39:03.625 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:39:03.625 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:39:03.625 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-04-25T13:39:03.625 INFO:teuthology.orchestra.run.smithi097.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T13:39:03.625 INFO:teuthology.orchestra.run.smithi097.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T13:39:03.626 INFO:teuthology.orchestra.run.smithi097.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T13:39:03.626 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T13:39:03.626 INFO:teuthology.orchestra.run.smithi097.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:03.626 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-25T13:39:03.627 INFO:teuthology.orchestra.run.smithi097.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T13:39:03.627 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T13:39:03.627 INFO:teuthology.orchestra.run.smithi097.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T13:39:03.643 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T13:39:03.644 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T13:39:03.645 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T13:39:03.656 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T13:39:03.657 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T13:39:03.659 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T13:39:03.660 INFO:teuthology.orchestra.run.smithi077.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T13:39:03.661 INFO:teuthology.orchestra.run.smithi077.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T13:39:03.662 INFO:teuthology.orchestra.run.smithi077.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T13:39:03.665 INFO:teuthology.orchestra.run.smithi077.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T13:39:03.667 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-25T13:39:03.668 INFO:teuthology.orchestra.run.smithi097.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T13:39:03.668 INFO:teuthology.orchestra.run.smithi097.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T13:39:03.669 INFO:teuthology.orchestra.run.smithi097.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T13:39:03.669 INFO:teuthology.orchestra.run.smithi097.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T13:39:03.669 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T13:39:03.669 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T13:39:03.669 INFO:teuthology.orchestra.run.smithi097.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:03.670 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-04-25T13:39:03.670 INFO:teuthology.orchestra.run.smithi097.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T13:39:03.684 INFO:teuthology.orchestra.run.smithi077.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T13:39:03.685 INFO:teuthology.orchestra.run.smithi077.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T13:39:03.686 INFO:teuthology.orchestra.run.smithi077.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T13:39:03.697 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.742 INFO:teuthology.orchestra.run.smithi097.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:39:03.742 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 55.7 MB of archives. 2024-04-25T13:39:03.742 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T13:39:03.742 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T13:39:03.822 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.880 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.944 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:39:03.945 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:39:04.013 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T13:39:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.020 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T13:39:04.067 INFO:teuthology.orchestra.run.smithi077.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T13:39:04.069 INFO:teuthology.orchestra.run.smithi077.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T13:39:04.069 INFO:teuthology.orchestra.run.smithi077.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T13:39:04.073 INFO:teuthology.orchestra.run.smithi077.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T13:39:04.073 INFO:teuthology.orchestra.run.smithi077.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T13:39:04.074 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T13:39:04.075 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T13:39:04.076 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T13:39:04.079 INFO:teuthology.orchestra.run.smithi077.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T13:39:04.082 INFO:teuthology.orchestra.run.smithi077.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T13:39:04.090 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T13:39:04.091 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T13:39:04.091 INFO:teuthology.orchestra.run.smithi077.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T13:39:04.091 INFO:teuthology.orchestra.run.smithi077.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T13:39:04.093 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T13:39:04.095 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T13:39:04.095 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T13:39:04.097 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T13:39:04.098 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T13:39:04.115 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:39:04.116 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:39:04.119 INFO:teuthology.orchestra.run.smithi077.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T13:39:04.119 INFO:teuthology.orchestra.run.smithi077.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T13:39:04.125 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T13:39:04.125 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T13:39:04.127 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T13:39:04.131 INFO:teuthology.orchestra.run.smithi077.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T13:39:04.140 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.172 INFO:teuthology.orchestra.run.smithi077.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T13:39:04.176 INFO:teuthology.orchestra.run.smithi077.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T13:39:04.176 INFO:teuthology.orchestra.run.smithi077.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T13:39:04.177 INFO:teuthology.orchestra.run.smithi077.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T13:39:04.177 INFO:teuthology.orchestra.run.smithi077.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T13:39:04.231 INFO:teuthology.orchestra.run.smithi077.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T13:39:04.236 INFO:teuthology.orchestra.run.smithi077.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T13:39:04.249 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.350 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:39:04.399 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.525 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.605 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.784 INFO:teuthology.orchestra.run.smithi077.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T13:39:04.784 INFO:teuthology.orchestra.run.smithi077.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T13:39:04.784 INFO:teuthology.orchestra.run.smithi077.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T13:39:04.785 INFO:teuthology.orchestra.run.smithi077.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T13:39:04.785 INFO:teuthology.orchestra.run.smithi077.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T13:39:04.785 INFO:teuthology.orchestra.run.smithi077.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T13:39:04.793 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T13:39:04.805 INFO:teuthology.orchestra.run.smithi077.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T13:39:04.805 INFO:teuthology.orchestra.run.smithi077.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T13:39:04.835 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T13:39:04.836 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T13:39:04.856 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T13:39:04.857 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T13:39:04.916 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T13:39:04.920 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T13:39:04.938 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T13:39:04.938 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T13:39:04.970 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:39:04.970 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:39:04.972 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:39:04.972 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:39:04.983 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T13:39:04.983 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T13:39:04.997 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T13:39:05.021 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T13:39:05.030 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T13:39:05.030 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T13:39:05.031 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T13:39:05.031 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T13:39:05.063 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T13:39:05.066 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T13:39:05.209 INFO:teuthology.orchestra.run.smithi077.stdout:Preconfiguring packages ... 2024-04-25T13:39:05.357 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 55.7 MB in 1s (39.1 MB/s) 2024-04-25T13:39:05.410 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:05.430 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T13:39:05.430 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T13:39:05.431 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T13:39:05.431 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T13:39:05.431 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T13:39:05.431 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T13:39:05.442 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:05.444 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T13:39:05.445 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T13:39:05.553 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:05.568 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:05.599 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:05.604 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:05.679 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:05.702 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:05.737 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:05.763 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T13:39:05.805 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:05.850 INFO:teuthology.orchestra.run.smithi097.stdout:Preconfiguring packages ... 2024-04-25T13:39:05.905 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:39:05.906 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:39:05.931 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:06.006 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 55.7 MB in 2s (31.5 MB/s) 2024-04-25T13:39:06.041 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:06.150 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:06.304 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:06.334 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:06.340 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:06.370 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:06.398 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:06.486 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:06.521 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:06.528 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:39:06.529 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:39:06.648 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:06.692 INFO:teuthology.orchestra.run.smithi151.stdout:Adding group ceph....done 2024-04-25T13:39:06.799 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:06.980 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:07.078 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user ceph....done 2024-04-25T13:39:07.107 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:07.143 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:39:07.204 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:39:07.204 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:39:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:Setting system user ceph properties....done 2024-04-25T13:39:07.254 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:39:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T13:39:07.349 INFO:teuthology.orchestra.run.smithi077.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T13:39:07.394 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T13:39:07.398 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:39:07.574 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package flex. 2024-04-25T13:39:07.634 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:07.639 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:07.674 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:07.681 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T13:39:07.753 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T13:39:07.926 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:39:07.927 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:39:08.041 INFO:teuthology.orchestra.run.smithi097.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T13:39:08.189 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:08.284 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:08.298 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:39:08.299 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package flex. 2024-04-25T13:39:08.354 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T13:39:08.401 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:08.402 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:08.407 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:08.455 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T13:39:08.492 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:39:08.492 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:39:08.502 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:08.653 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:08.773 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:08.863 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:39:08.863 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:39:08.909 INFO:teuthology.orchestra.run.smithi191.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:39:08.912 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T13:39:08.922 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:08.967 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:39:08.969 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:09.086 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:09.103 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T13:39:09.167 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-25T13:39:09.168 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-25T13:39:09.304 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:09.314 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:09.320 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:09.346 INFO:teuthology.orchestra.run.smithi191.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T13:39:09.347 INFO:teuthology.orchestra.run.smithi191.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T13:39:09.347 INFO:teuthology.orchestra.run.smithi191.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T13:39:09.347 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:39:09.347 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:39:09.347 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:39:09.347 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:39:09.347 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:39:09.348 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:39:09.348 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:39:09.348 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2024-04-25T13:39:09.348 INFO:teuthology.orchestra.run.smithi191.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T13:39:09.348 INFO:teuthology.orchestra.run.smithi191.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T13:39:09.349 INFO:teuthology.orchestra.run.smithi191.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T13:39:09.349 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T13:39:09.349 INFO:teuthology.orchestra.run.smithi191.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:09.350 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2024-04-25T13:39:09.350 INFO:teuthology.orchestra.run.smithi191.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T13:39:09.350 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T13:39:09.351 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T13:39:09.389 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2024-04-25T13:39:09.390 INFO:teuthology.orchestra.run.smithi191.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T13:39:09.390 INFO:teuthology.orchestra.run.smithi191.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T13:39:09.391 INFO:teuthology.orchestra.run.smithi191.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T13:39:09.391 INFO:teuthology.orchestra.run.smithi191.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T13:39:09.391 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T13:39:09.391 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T13:39:09.391 INFO:teuthology.orchestra.run.smithi191.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:09.392 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages will be upgraded: 2024-04-25T13:39:09.393 INFO:teuthology.orchestra.run.smithi191.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T13:39:09.444 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:09.455 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:09.505 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:09.539 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:39:09.539 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:39:09.573 INFO:teuthology.orchestra.run.smithi191.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:39:09.574 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 55.7 MB of archives. 2024-04-25T13:39:09.574 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T13:39:09.574 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T13:39:09.582 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:09.732 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:09.816 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:09.934 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:09.997 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:10.007 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:10.013 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:10.110 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:39:10.152 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:10.211 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:39:10.214 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T13:39:10.232 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T13:39:10.355 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:39:10.360 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T13:39:10.361 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T13:39:10.362 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T13:39:10.389 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T13:39:10.391 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T13:39:10.394 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T13:39:10.395 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:10.397 INFO:teuthology.orchestra.run.smithi191.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T13:39:10.398 INFO:teuthology.orchestra.run.smithi191.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T13:39:10.552 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:10.564 INFO:teuthology.orchestra.run.smithi191.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T13:39:10.684 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:10.738 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T13:39:10.768 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package bison. 2024-04-25T13:39:10.857 INFO:teuthology.orchestra.run.smithi191.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T13:39:10.867 INFO:teuthology.orchestra.run.smithi191.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T13:39:10.870 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:10.871 INFO:teuthology.orchestra.run.smithi191.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T13:39:10.876 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:10.929 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:10.956 INFO:teuthology.orchestra.run.smithi191.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T13:39:11.020 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:11.224 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:11.354 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T13:39:11.382 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T13:39:11.393 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package bison. 2024-04-25T13:39:11.421 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:11.431 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:39:11.431 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:39:11.494 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:11.499 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:11.545 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:11.549 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:39:11.716 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package dump. 2024-04-25T13:39:11.743 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T13:39:11.773 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T13:39:11.926 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:11.929 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T13:39:11.957 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T13:39:11.995 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:12.045 INFO:teuthology.orchestra.run.smithi191.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T13:39:12.049 INFO:teuthology.orchestra.run.smithi191.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T13:39:12.049 INFO:teuthology.orchestra.run.smithi191.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T13:39:12.055 INFO:teuthology.orchestra.run.smithi191.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T13:39:12.055 INFO:teuthology.orchestra.run.smithi191.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T13:39:12.065 INFO:teuthology.orchestra.run.smithi191.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T13:39:12.144 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:39:12.144 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:39:12.179 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package indent. 2024-04-25T13:39:12.196 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:39:12.199 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T13:39:12.207 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:12.232 INFO:teuthology.orchestra.run.smithi191.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T13:39:12.245 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:12.250 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-25T13:39:12.306 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package dump. 2024-04-25T13:39:12.334 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T13:39:12.365 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T13:39:12.428 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-25T13:39:12.429 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-25T13:39:12.506 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T13:39:12.522 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T13:39:12.564 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:12.602 INFO:teuthology.orchestra.run.smithi096.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T13:39:12.602 INFO:teuthology.orchestra.run.smithi096.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T13:39:12.602 INFO:teuthology.orchestra.run.smithi096.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T13:39:12.602 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:39:12.602 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:39:12.602 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:39:12.602 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:39:12.603 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:39:12.603 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:39:12.603 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:39:12.604 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-25T13:39:12.604 INFO:teuthology.orchestra.run.smithi096.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T13:39:12.604 INFO:teuthology.orchestra.run.smithi096.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T13:39:12.604 INFO:teuthology.orchestra.run.smithi096.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T13:39:12.604 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T13:39:12.604 INFO:teuthology.orchestra.run.smithi096.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:12.605 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-25T13:39:12.606 INFO:teuthology.orchestra.run.smithi096.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T13:39:12.606 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T13:39:12.606 INFO:teuthology.orchestra.run.smithi096.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T13:39:12.643 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package indent. 2024-04-25T13:39:12.646 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-25T13:39:12.646 INFO:teuthology.orchestra.run.smithi096.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T13:39:12.646 INFO:teuthology.orchestra.run.smithi096.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T13:39:12.647 INFO:teuthology.orchestra.run.smithi096.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T13:39:12.647 INFO:teuthology.orchestra.run.smithi096.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T13:39:12.647 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T13:39:12.647 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T13:39:12.647 INFO:teuthology.orchestra.run.smithi096.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:12.648 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-25T13:39:12.648 INFO:teuthology.orchestra.run.smithi096.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T13:39:12.661 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:12.702 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:12.707 INFO:teuthology.orchestra.run.smithi096.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:39:12.707 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 55.7 MB of archives. 2024-04-25T13:39:12.707 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T13:39:12.707 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T13:39:12.828 INFO:teuthology.orchestra.run.smithi191.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T13:39:12.828 INFO:teuthology.orchestra.run.smithi191.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T13:39:12.836 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:12.867 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T13:39:12.874 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T13:39:12.893 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T13:39:12.915 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T13:39:12.916 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T13:39:12.917 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T13:39:12.921 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T13:39:12.927 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T13:39:12.928 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T13:39:12.930 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T13:39:12.932 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T13:39:12.932 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T13:39:12.933 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T13:39:12.937 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T13:39:12.955 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T13:39:12.956 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T13:39:12.957 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T13:39:12.960 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:12.971 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T13:39:12.999 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T13:39:13.008 INFO:teuthology.orchestra.run.smithi191.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T13:39:13.009 INFO:teuthology.orchestra.run.smithi191.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T13:39:13.038 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:13.047 INFO:teuthology.orchestra.run.smithi191.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T13:39:13.110 INFO:teuthology.orchestra.run.smithi191.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T13:39:13.117 INFO:teuthology.orchestra.run.smithi191.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T13:39:13.118 INFO:teuthology.orchestra.run.smithi191.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T13:39:13.119 INFO:teuthology.orchestra.run.smithi191.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T13:39:13.120 INFO:teuthology.orchestra.run.smithi191.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T13:39:13.127 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:39:13.127 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:39:13.270 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T13:39:13.270 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T13:39:13.270 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T13:39:13.271 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T13:39:13.273 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T13:39:13.273 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T13:39:13.277 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T13:39:13.278 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T13:39:13.285 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T13:39:13.286 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T13:39:13.299 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T13:39:13.306 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T13:39:13.309 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T13:39:13.319 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T13:39:13.327 INFO:teuthology.orchestra.run.smithi191.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T13:39:13.343 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T13:39:13.346 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:13.346 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T13:39:13.347 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T13:39:13.347 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T13:39:13.348 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T13:39:13.358 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T13:39:13.360 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T13:39:13.375 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T13:39:13.403 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T13:39:13.433 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:13.575 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T13:39:13.575 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T13:39:13.575 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T13:39:13.576 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T13:39:13.576 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T13:39:13.576 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T13:39:13.587 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T13:39:13.588 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T13:39:13.613 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:13.686 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T13:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T13:39:13.702 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T13:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:13.738 INFO:teuthology.orchestra.run.smithi191.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T13:39:13.739 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:13.744 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:13.898 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:13.994 INFO:teuthology.orchestra.run.smithi096.stdout:Preconfiguring packages ... 2024-04-25T13:39:14.027 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T13:39:14.055 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:14.073 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T13:39:14.092 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:39:14.092 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:39:14.093 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:14.100 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:14.139 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:14.149 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 55.7 MB in 1s (59.8 MB/s) 2024-04-25T13:39:14.363 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T13:39:14.390 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T13:39:14.400 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T13:39:14.428 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:14.437 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T13:39:14.467 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:14.470 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:14.476 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:14.574 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:14.580 INFO:teuthology.orchestra.run.smithi191.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T13:39:14.581 INFO:teuthology.orchestra.run.smithi191.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T13:39:14.581 INFO:teuthology.orchestra.run.smithi191.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T13:39:14.582 INFO:teuthology.orchestra.run.smithi191.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T13:39:14.582 INFO:teuthology.orchestra.run.smithi191.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T13:39:14.582 INFO:teuthology.orchestra.run.smithi191.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T13:39:14.609 INFO:teuthology.orchestra.run.smithi191.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T13:39:14.609 INFO:teuthology.orchestra.run.smithi191.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T13:39:14.621 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:14.694 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T13:39:14.710 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T13:39:14.717 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:14.753 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T13:39:14.807 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T13:39:14.835 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T13:39:14.843 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:14.882 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:14.994 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:15.013 INFO:teuthology.orchestra.run.smithi191.stdout:Preconfiguring packages ... 2024-04-25T13:39:15.073 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T13:39:15.101 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T13:39:15.139 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:15.200 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 55.7 MB in 5s (10.7 MB/s) 2024-04-25T13:39:15.269 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:15.338 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:39:15.439 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:39:15.459 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:15.465 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:15.591 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:39:15.597 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:16.185 INFO:teuthology.orchestra.run.smithi096.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T13:39:16.216 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:16.536 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T13:39:16.563 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:16.571 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package flex. 2024-04-25T13:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:16.667 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:39:16.670 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:16.676 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:16.720 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T13:39:16.801 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T13:39:16.828 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:16.859 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:16.871 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T13:39:16.887 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:16.929 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:17.111 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T13:39:17.127 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:17.154 INFO:teuthology.orchestra.run.smithi191.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T13:39:17.170 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:17.261 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:39:17.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T13:39:17.316 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T13:39:17.345 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:17.383 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:17.383 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:39:17.434 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T13:39:17.477 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package flex. 2024-04-25T13:39:17.489 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T13:39:17.517 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:17.556 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:17.563 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-04-25T13:39:17.563 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-04-25T13:39:17.570 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:17.576 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:17.625 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T13:39:17.734 INFO:teuthology.orchestra.run.smithi151.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T13:39:17.734 INFO:teuthology.orchestra.run.smithi151.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T13:39:17.734 INFO:teuthology.orchestra.run.smithi151.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T13:39:17.734 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:39:17.734 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:39:17.734 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:39:17.734 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:39:17.734 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:39:17.735 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:39:17.735 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:39:17.735 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-04-25T13:39:17.735 INFO:teuthology.orchestra.run.smithi151.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T13:39:17.735 INFO:teuthology.orchestra.run.smithi151.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T13:39:17.736 INFO:teuthology.orchestra.run.smithi151.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T13:39:17.736 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T13:39:17.736 INFO:teuthology.orchestra.run.smithi151.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:17.736 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T13:39:17.737 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-04-25T13:39:17.737 INFO:teuthology.orchestra.run.smithi151.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T13:39:17.737 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T13:39:17.737 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T13:39:17.765 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T13:39:17.777 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-04-25T13:39:17.778 INFO:teuthology.orchestra.run.smithi151.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T13:39:17.778 INFO:teuthology.orchestra.run.smithi151.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T13:39:17.779 INFO:teuthology.orchestra.run.smithi151.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T13:39:17.779 INFO:teuthology.orchestra.run.smithi151.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T13:39:17.779 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T13:39:17.779 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T13:39:17.779 INFO:teuthology.orchestra.run.smithi151.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:39:17.780 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-04-25T13:39:17.780 INFO:teuthology.orchestra.run.smithi151.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T13:39:17.802 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:17.819 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:17.867 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T13:39:17.895 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T13:39:17.934 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:17.963 INFO:teuthology.orchestra.run.smithi151.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:39:17.963 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 55.7 MB of archives. 2024-04-25T13:39:17.963 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T13:39:17.963 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T13:39:18.141 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:18.155 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T13:39:18.182 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:18.230 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:18.261 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T13:39:18.289 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:18.314 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T13:39:18.328 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:18.339 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:18.344 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:18.484 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:18.599 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T13:39:18.615 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T13:39:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T13:39:18.673 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T13:39:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:18.700 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:18.716 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:18.739 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:18.741 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T13:39:18.742 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T13:39:18.744 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T13:39:18.750 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:18.772 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T13:39:18.774 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T13:39:18.777 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T13:39:18.780 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T13:39:18.781 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T13:39:18.902 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:18.948 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T13:39:19.018 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T13:39:19.032 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:19.045 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:19.063 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T13:39:19.084 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:19.091 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:19.130 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:19.242 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T13:39:19.251 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T13:39:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T13:39:19.269 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:19.274 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:19.341 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T13:39:19.344 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:19.378 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T13:39:19.394 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:19.421 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:19.436 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:19.440 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T13:39:19.465 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:19.507 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:19.664 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T13:39:19.680 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:19.709 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package bison. 2024-04-25T13:39:19.722 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:19.743 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T13:39:19.771 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:19.788 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:19.801 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:19.813 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:19.818 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:19.869 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:19.920 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:20.209 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T13:39:20.237 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T13:39:20.246 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:20.262 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T13:39:20.276 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:20.289 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T13:39:20.322 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T13:39:20.328 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:20.350 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T13:39:20.389 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:20.425 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T13:39:20.430 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T13:39:20.430 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T13:39:20.437 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T13:39:20.438 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T13:39:20.448 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T13:39:20.570 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package bison. 2024-04-25T13:39:20.614 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package dump. 2024-04-25T13:39:20.615 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T13:39:20.631 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T13:39:20.654 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package modemmanager. 2024-04-25T13:39:20.665 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T13:39:20.671 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:20.677 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:20.682 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:20.717 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package modemmanager. 2024-04-25T13:39:20.720 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:20.722 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:20.783 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:20.952 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package indent. 2024-04-25T13:39:20.968 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:21.010 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:21.072 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T13:39:21.089 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T13:39:21.122 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:21.208 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T13:39:21.208 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T13:39:21.280 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T13:39:21.307 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T13:39:21.346 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:21.352 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager. 2024-04-25T13:39:21.380 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:21.387 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T13:39:21.388 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T13:39:21.424 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package network-manager. 2024-04-25T13:39:21.426 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T13:39:21.427 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:21.450 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package dump. 2024-04-25T13:39:21.452 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:21.479 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T13:39:21.487 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T13:39:21.494 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T13:39:21.495 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T13:39:21.495 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T13:39:21.496 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T13:39:21.499 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:21.517 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T13:39:21.704 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T13:39:21.719 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T13:39:21.747 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T13:39:21.786 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:21.821 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package indent. 2024-04-25T13:39:21.837 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:21.946 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:22.018 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ppp. 2024-04-25T13:39:22.045 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T13:39:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T13:39:22.074 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T13:39:22.115 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T13:39:22.130 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:22.140 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ppp. 2024-04-25T13:39:22.168 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T13:39:22.241 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T13:39:22.268 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T13:39:22.305 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:22.307 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:22.417 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T13:39:22.433 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:22.467 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:22.471 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:22.606 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T13:39:22.623 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T13:39:22.636 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T13:39:22.663 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T13:39:22.680 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:22.694 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T13:39:22.702 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:22.710 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:22.745 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:22.922 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T13:39:22.928 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T13:39:22.928 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T13:39:22.929 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T13:39:22.929 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T13:39:22.930 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T13:39:22.930 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T13:39:22.937 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T13:39:22.942 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T13:39:22.955 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T13:39:22.956 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T13:39:22.969 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T13:39:22.972 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:22.981 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T13:39:23.008 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T13:39:23.008 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:23.022 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T13:39:23.038 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T13:39:23.047 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T13:39:23.072 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:23.300 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T13:39:23.311 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T13:39:23.316 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T13:39:23.325 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T13:39:23.339 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T13:39:23.352 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:23.358 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:23.359 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T13:39:23.366 INFO:teuthology.orchestra.run.smithi151.stdout:Preconfiguring packages ... 2024-04-25T13:39:23.378 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T13:39:23.386 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T13:39:23.391 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:23.428 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:23.520 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 55.7 MB in 5s (10.8 MB/s) 2024-04-25T13:39:23.644 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T13:39:23.648 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T13:39:23.661 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T13:39:23.664 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:23.671 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:23.689 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T13:39:23.698 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:23.710 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:23.728 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T13:39:23.839 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:23.845 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:23.980 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T13:39:23.982 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:23.996 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T13:39:24.007 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T13:39:24.035 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:24.038 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T13:39:24.073 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:24.245 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T13:39:24.273 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T13:39:24.316 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T13:39:24.330 INFO:teuthology.orchestra.run.smithi097.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T13:39:24.332 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T13:39:24.366 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:24.367 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-common (238) ... 2024-04-25T13:39:24.637 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T13:39:24.665 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T13:39:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:24.721 INFO:teuthology.orchestra.run.smithi077.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T13:39:24.751 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-common (238) ... 2024-04-25T13:39:24.835 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T13:39:24.863 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:24.905 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:25.081 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T13:39:25.108 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:25.147 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:25.202 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T13:39:25.231 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:25.273 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:25.416 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T13:39:25.432 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:25.474 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:25.680 INFO:teuthology.orchestra.run.smithi151.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T13:39:25.820 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T13:39:25.847 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:25.886 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:25.936 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package flex. 2024-04-25T13:39:26.019 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T13:39:26.029 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T13:39:26.035 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:26.047 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:26.084 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T13:39:26.086 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:26.105 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql. 2024-04-25T13:39:26.122 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T13:39:26.231 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T13:39:26.246 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql (14+238) ... 2024-04-25T13:39:26.258 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T13:39:26.297 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:26.364 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T13:39:26.391 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:26.430 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:26.490 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T13:39:26.506 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T13:39:26.548 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T13:39:26.614 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql. 2024-04-25T13:39:26.617 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:26.625 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T13:39:26.629 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T13:39:26.653 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:26.673 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql (14+238) ... 2024-04-25T13:39:26.758 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T13:39:26.760 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:26.786 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:26.790 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T13:39:26.792 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T13:39:26.820 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T13:39:26.824 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:26.859 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T13:39:26.917 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T13:39:26.933 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T13:39:26.975 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T13:39:27.064 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T13:39:27.092 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:27.130 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:27.152 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T13:39:27.179 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T13:39:27.186 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T13:39:27.209 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:27.210 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:27.214 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:27.219 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T13:39:27.247 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T13:39:27.253 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:27.285 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T13:39:27.459 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T13:39:27.486 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:27.497 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl. 2024-04-25T13:39:27.516 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T13:39:27.525 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:27.561 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T13:39:27.605 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T13:39:27.614 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T13:39:27.634 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:27.642 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:27.671 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:27.681 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:27.728 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:27.733 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:27.828 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T13:39:27.856 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:27.864 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:27.895 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:27.908 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T13:39:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package tcl. 2024-04-25T13:39:27.937 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T13:39:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T13:39:27.983 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T13:39:28.034 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T13:39:28.061 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:28.100 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:28.114 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T13:39:28.130 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:28.164 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:28.315 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:39:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T13:39:28.362 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T13:39:28.379 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T13:39:28.380 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T13:39:28.412 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T13:39:28.419 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:28.421 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:28.439 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:28.454 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:39:28.470 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:28.693 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T13:39:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T13:39:28.741 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T13:39:28.756 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T13:39:28.759 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:28.769 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T13:39:28.772 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:28.789 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:28.790 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T13:39:28.807 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:28.814 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:28.818 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T13:39:28.857 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:29.075 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T13:39:29.102 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:29.112 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T13:39:29.113 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package modemmanager. 2024-04-25T13:39:29.140 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:29.146 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package bison. 2024-04-25T13:39:29.149 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:29.169 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T13:39:29.179 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:29.196 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T13:39:29.234 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:29.250 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T13:39:29.256 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:29.296 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T13:39:29.307 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:29.422 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:29.523 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T13:39:29.548 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:29.674 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:29.691 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T13:39:29.716 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T13:39:29.737 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T13:39:29.743 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T13:39:29.765 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T13:39:29.782 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:29.809 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:29.811 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:29.887 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package network-manager. 2024-04-25T13:39:29.915 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:29.920 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:30.028 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:30.061 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:30.118 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package dump. 2024-04-25T13:39:30.146 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T13:39:30.173 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package modemmanager. 2024-04-25T13:39:30.185 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T13:39:30.187 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:30.201 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:30.239 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:30.314 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:30.393 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T13:39:30.480 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package indent. 2024-04-25T13:39:30.484 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:30.496 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:30.530 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:30.669 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ppp. 2024-04-25T13:39:30.697 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T13:39:30.732 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T13:39:30.737 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T13:39:30.749 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T13:39:30.782 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:30.827 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:30.863 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:30.863 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:30.921 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package network-manager. 2024-04-25T13:39:30.948 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:30.956 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:30.996 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:31.111 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T13:39:31.139 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T13:39:31.178 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:31.201 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:31.201 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:31.266 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T13:39:31.294 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T13:39:31.332 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:31.337 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:31.438 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:31.447 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T13:39:31.475 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T13:39:31.513 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:31.553 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ppp. 2024-04-25T13:39:31.564 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:31.568 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T13:39:31.580 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T13:39:31.585 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T13:39:31.635 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:31.690 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:31.706 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:31.807 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:31.825 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T13:39:31.833 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:31.853 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:31.854 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:31.884 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:31.908 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:31.959 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:32.026 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:32.099 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T13:39:32.102 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T13:39:32.110 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:32.127 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T13:39:32.130 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T13:39:32.149 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T13:39:32.152 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:32.166 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T13:39:32.169 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:32.177 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T13:39:32.216 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:32.245 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:32.404 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:32.414 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T13:39:32.441 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T13:39:32.445 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T13:39:32.473 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:32.480 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T13:39:32.503 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:32.530 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:32.554 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T13:39:32.570 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T13:39:32.612 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:32.742 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T13:39:32.758 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T13:39:32.791 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:32.841 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:32.881 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T13:39:32.909 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T13:39:32.939 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T13:39:32.951 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T13:39:33.046 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T13:39:33.091 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T13:39:33.103 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:33.119 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T13:39:33.175 INFO:teuthology.orchestra.run.smithi096.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T13:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:33.205 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-common (238) ... 2024-04-25T13:39:33.237 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:33.243 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T13:39:33.271 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:33.309 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:33.320 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T13:39:33.363 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T13:39:33.414 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T13:39:33.480 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:33.489 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T13:39:33.615 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:33.640 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T13:39:33.668 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:33.702 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:33.706 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T13:39:33.748 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:33.775 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:33.876 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:33.881 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T13:39:33.890 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T13:39:33.909 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T13:39:33.966 INFO:teuthology.orchestra.run.smithi191.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T13:39:33.995 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking postgresql-common (238) ... 2024-04-25T13:39:34.016 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T13:39:34.052 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:34.117 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:34.178 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:34.191 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T13:39:34.261 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:34.307 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:34.345 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T13:39:34.373 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:34.387 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:34.411 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:34.471 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T13:39:34.499 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:34.542 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:34.563 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:34.607 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:34.681 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T13:39:34.698 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:34.709 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:39:34.747 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:34.824 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:34.992 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T13:39:35.017 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T13:39:35.033 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:35.044 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql. 2024-04-25T13:39:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:39:35.063 INFO:teuthology.orchestra.run.smithi097.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T13:39:35.063 INFO:teuthology.orchestra.run.smithi097.stdout:which means they are currently configured by ifupdown: 2024-04-25T13:39:35.063 INFO:teuthology.orchestra.run.smithi097.stdout:- enp3s0f1 2024-04-25T13:39:35.063 INFO:teuthology.orchestra.run.smithi097.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T13:39:35.063 INFO:teuthology.orchestra.run.smithi097.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T13:39:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:39:35.067 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:35.070 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T13:39:35.093 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:35.119 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql (14+238) ... 2024-04-25T13:39:35.174 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T13:39:35.403 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T13:39:35.430 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T13:39:35.431 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T13:39:35.458 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T13:39:35.469 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:35.471 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T13:39:35.496 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T13:39:35.534 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:39:35.534 INFO:teuthology.orchestra.run.smithi077.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T13:39:35.534 INFO:teuthology.orchestra.run.smithi077.stdout:which means they are currently configured by ifupdown: 2024-04-25T13:39:35.534 INFO:teuthology.orchestra.run.smithi077.stdout:- enp3s0f1 2024-04-25T13:39:35.534 INFO:teuthology.orchestra.run.smithi077.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T13:39:35.534 INFO:teuthology.orchestra.run.smithi077.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T13:39:35.534 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:39:35.645 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T13:39:35.690 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T13:39:35.706 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T13:39:35.740 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T13:39:35.806 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T13:39:35.834 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:35.872 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:35.959 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T13:39:36.007 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T13:39:36.032 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package postgresql. 2024-04-25T13:39:36.059 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T13:39:36.062 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T13:39:36.088 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:36.099 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking postgresql (14+238) ... 2024-04-25T13:39:36.126 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:36.167 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T13:39:36.195 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:36.225 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:36.283 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T13:39:36.342 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T13:39:36.359 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T13:39:36.400 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T13:39:36.412 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package tcl. 2024-04-25T13:39:36.440 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T13:39:36.484 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T13:39:36.493 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:36.544 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T13:39:36.572 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:36.611 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:36.636 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T13:39:36.652 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T13:39:36.653 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:36.686 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T13:39:36.773 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T13:39:36.779 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:36.790 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T13:39:36.804 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:36.832 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:36.897 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-common (238) ... 2024-04-25T13:39:36.922 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T13:39:36.938 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:36.947 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T13:39:36.947 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:36.975 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:36.980 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:37.013 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:37.065 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:37.166 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-common (238) ... 2024-04-25T13:39:37.258 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T13:39:37.274 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:39:37.299 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package tcl. 2024-04-25T13:39:37.316 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:37.328 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T13:39:37.371 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T13:39:37.686 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T13:39:37.702 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T13:39:37.727 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T13:39:37.753 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:37.755 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T13:39:37.757 INFO:teuthology.orchestra.run.smithi097.stdout:Adding user postgres to group ssl-cert 2024-04-25T13:39:37.793 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:37.819 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T13:39:37.847 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T13:39:37.886 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:37.986 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:39:37.987 INFO:teuthology.orchestra.run.smithi097.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T13:39:38.069 INFO:teuthology.orchestra.run.smithi077.stdout:Adding user postgres to group ssl-cert 2024-04-25T13:39:38.131 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T13:39:38.156 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T13:39:38.159 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T13:39:38.173 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T13:39:38.174 INFO:teuthology.orchestra.run.smithi097.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T13:39:38.174 INFO:teuthology.orchestra.run.smithi097.stdout:Removing obsolete dictionary files: 2024-04-25T13:39:38.189 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package modemmanager. 2024-04-25T13:39:38.206 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:38.206 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:38.217 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:39:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:38.297 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:39:38.297 INFO:teuthology.orchestra.run.smithi077.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T13:39:38.498 INFO:teuthology.orchestra.run.smithi077.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T13:39:38.498 INFO:teuthology.orchestra.run.smithi077.stdout:Removing obsolete dictionary files: 2024-04-25T13:39:38.519 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T13:39:38.592 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T13:39:38.621 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T13:39:38.667 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:38.707 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T13:39:38.737 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T13:39:38.863 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:38.963 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T13:39:38.964 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:38.988 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package network-manager. 2024-04-25T13:39:39.015 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:39:39.063 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:39.065 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:39.072 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T13:39:39.082 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:39.148 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T13:39:39.191 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:39.249 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:39.318 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:39.358 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:39.386 INFO:teuthology.orchestra.run.smithi097.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T13:39:39.407 INFO:teuthology.orchestra.run.smithi097.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:This user must also own the server process. 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:The default text search configuration will be set to "english". 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:Data page checksums are disabled. 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:creating subdirectories ... ok 2024-04-25T13:39:39.452 INFO:teuthology.orchestra.run.smithi097.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T13:39:39.460 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:39.468 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default max_connections ... 100 2024-04-25T13:39:39.484 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:39.488 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default shared_buffers ... 128MB 2024-04-25T13:39:39.498 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default time zone ... Etc/UTC 2024-04-25T13:39:39.499 INFO:teuthology.orchestra.run.smithi097.stdout:creating configuration files ... ok 2024-04-25T13:39:39.610 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:39.612 INFO:teuthology.orchestra.run.smithi097.stdout:running bootstrap script ... ok 2024-04-25T13:39:39.639 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ppp. 2024-04-25T13:39:39.667 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T13:39:39.736 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:39.784 INFO:teuthology.orchestra.run.smithi077.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T13:39:39.806 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T13:39:39.823 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:This user must also own the server process. 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:The default text search configuration will be set to "english". 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:Data page checksums are disabled. 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:creating subdirectories ... ok 2024-04-25T13:39:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T13:39:39.863 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default max_connections ... 100 2024-04-25T13:39:39.885 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default shared_buffers ... 128MB 2024-04-25T13:39:39.894 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default time zone ... Etc/UTC 2024-04-25T13:39:39.895 INFO:teuthology.orchestra.run.smithi077.stdout:creating configuration files ... ok 2024-04-25T13:39:39.915 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:39.931 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:40.009 INFO:teuthology.orchestra.run.smithi077.stdout:running bootstrap script ... ok 2024-04-25T13:39:40.235 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T13:39:40.238 INFO:teuthology.orchestra.run.smithi097.stdout:performing post-bootstrap initialization ... ok 2024-04-25T13:39:40.260 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T13:39:40.288 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T13:39:40.304 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:40.304 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:40.327 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:40.333 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:40.588 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T13:39:40.616 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T13:39:40.655 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:40.659 INFO:teuthology.orchestra.run.smithi077.stdout:performing post-bootstrap initialization ... ok 2024-04-25T13:39:40.717 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:40.717 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:40.752 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:40.869 INFO:teuthology.orchestra.run.smithi097.stdout:syncing data to disk ... ok 2024-04-25T13:39:40.886 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:40.983 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T13:39:40.999 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T13:39:41.012 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:41.033 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T13:39:41.138 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:41.236 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:41.239 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:41.285 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T13:39:41.303 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T13:39:41.312 INFO:teuthology.orchestra.run.smithi077.stdout:syncing data to disk ... ok 2024-04-25T13:39:41.331 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:41.340 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:41.354 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:41.370 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:41.458 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:41.480 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:41.584 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:41.606 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:41.726 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T13:39:41.731 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:41.857 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:41.958 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T13:39:41.983 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:41.986 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T13:39:42.043 INFO:teuthology.orchestra.run.smithi151.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T13:39:42.064 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-common (238) ... 2024-04-25T13:39:42.118 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:42.214 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:42.315 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T13:39:42.401 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T13:39:42.467 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:42.482 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T13:39:42.509 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:39:42.551 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:42.977 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:43.112 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T13:39:43.254 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T13:39:43.306 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:43.380 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:43.416 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T13:39:43.470 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T13:39:43.509 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T13:39:43.540 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:43.576 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:43.658 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:43.702 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:43.828 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T13:39:43.910 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:43.962 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T13:39:44.030 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:44.045 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:44.088 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:44.131 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T13:39:44.178 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T13:39:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T13:39:44.239 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:44.240 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql (14+238) ... 2024-04-25T13:39:44.334 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql. 2024-04-25T13:39:44.339 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:44.340 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:44.351 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T13:39:44.366 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:44.393 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql (14+238) ... 2024-04-25T13:39:44.475 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:44.492 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:44.500 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:44.601 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T13:39:44.626 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:44.628 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T13:39:44.656 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T13:39:44.695 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T13:39:44.702 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql (14+238) ... 2024-04-25T13:39:44.745 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:39:44.745 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:39:44.752 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:44.803 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:44.806 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:39:44.806 INFO:teuthology.orchestra.run.smithi096.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T13:39:44.806 INFO:teuthology.orchestra.run.smithi096.stdout:which means they are currently configured by ifupdown: 2024-04-25T13:39:44.806 INFO:teuthology.orchestra.run.smithi096.stdout:- enp3s0f1 2024-04-25T13:39:44.806 INFO:teuthology.orchestra.run.smithi096.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T13:39:44.806 INFO:teuthology.orchestra.run.smithi096.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T13:39:44.806 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:39:44.920 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T13:39:44.921 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:44.922 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T13:39:44.930 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T13:39:44.958 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T13:39:44.988 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T13:39:45.046 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:45.174 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:39:45.174 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:39:45.221 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T13:39:45.304 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:39:45.333 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T13:39:45.361 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T13:39:45.396 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T13:39:45.399 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:45.518 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:39:45.518 INFO:teuthology.orchestra.run.smithi191.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T13:39:45.518 INFO:teuthology.orchestra.run.smithi191.stdout:which means they are currently configured by ifupdown: 2024-04-25T13:39:45.518 INFO:teuthology.orchestra.run.smithi191.stdout:- enp3s0f1 2024-04-25T13:39:45.518 INFO:teuthology.orchestra.run.smithi191.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T13:39:45.518 INFO:teuthology.orchestra.run.smithi191.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T13:39:45.518 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:39:45.534 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T13:39:45.647 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T13:39:45.682 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:39:45.685 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package tcl. 2024-04-25T13:39:45.713 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T13:39:45.749 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:39:45.757 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T13:39:45.825 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:39:45.866 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T13:39:45.956 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T13:39:46.000 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:46.055 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T13:39:46.083 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T13:39:46.113 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:46.143 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:39:46.151 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:46.278 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T13:39:46.286 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:46.303 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:39:46.421 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-common (238) ... 2024-04-25T13:39:46.467 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T13:39:46.495 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T13:39:46.534 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:46.773 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:46.912 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T13:39:46.916 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:46.940 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T13:39:46.987 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:47.042 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:47.145 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T13:39:47.151 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up postgresql-common (238) ... 2024-04-25T13:39:47.262 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:39:47.301 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T13:39:47.482 INFO:teuthology.orchestra.run.smithi096.stdout:Adding user postgres to group ssl-cert 2024-04-25T13:39:47.510 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T13:39:47.591 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T13:39:47.636 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:39:47.699 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:39:47.722 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:39:47.728 DEBUG:teuthology.parallel:result is None 2024-04-25T13:39:47.753 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:47.863 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:39:47.890 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:39:47.891 INFO:teuthology.orchestra.run.smithi096.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T13:39:47.972 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:39:48.098 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:48.201 INFO:teuthology.orchestra.run.smithi077.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:39:48.207 DEBUG:teuthology.parallel:result is None 2024-04-25T13:39:48.358 INFO:teuthology.orchestra.run.smithi096.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T13:39:48.358 INFO:teuthology.orchestra.run.smithi096.stdout:Removing obsolete dictionary files: 2024-04-25T13:39:48.373 INFO:teuthology.orchestra.run.smithi191.stdout:Adding user postgres to group ssl-cert 2024-04-25T13:39:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:39:48.593 INFO:teuthology.orchestra.run.smithi191.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T13:39:48.617 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T13:39:48.704 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:39:48.758 INFO:teuthology.orchestra.run.smithi191.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T13:39:48.758 INFO:teuthology.orchestra.run.smithi191.stdout:Removing obsolete dictionary files: 2024-04-25T13:39:48.898 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T13:39:49.060 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:49.060 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:39:49.259 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:49.305 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T13:39:49.574 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:39:49.604 INFO:teuthology.orchestra.run.smithi096.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T13:39:49.624 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T13:39:49.669 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:49.676 INFO:teuthology.orchestra.run.smithi096.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T13:39:49.676 INFO:teuthology.orchestra.run.smithi096.stdout:This user must also own the server process. 2024-04-25T13:39:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:39:49.676 INFO:teuthology.orchestra.run.smithi096.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T13:39:49.676 INFO:teuthology.orchestra.run.smithi096.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T13:39:49.676 INFO:teuthology.orchestra.run.smithi096.stdout:The default text search configuration will be set to "english". 2024-04-25T13:39:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:39:49.676 INFO:teuthology.orchestra.run.smithi096.stdout:Data page checksums are disabled. 2024-04-25T13:39:49.676 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:39:49.677 INFO:teuthology.orchestra.run.smithi096.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T13:39:49.677 INFO:teuthology.orchestra.run.smithi096.stdout:creating subdirectories ... ok 2024-04-25T13:39:49.677 INFO:teuthology.orchestra.run.smithi096.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T13:39:49.692 INFO:teuthology.orchestra.run.smithi096.stdout:selecting default max_connections ... 100 2024-04-25T13:39:49.708 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:39:49.713 INFO:teuthology.orchestra.run.smithi096.stdout:selecting default shared_buffers ... 128MB 2024-04-25T13:39:49.723 INFO:teuthology.orchestra.run.smithi096.stdout:selecting default time zone ... Etc/UTC 2024-04-25T13:39:49.724 INFO:teuthology.orchestra.run.smithi096.stdout:creating configuration files ... ok 2024-04-25T13:39:49.834 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:39:49.838 INFO:teuthology.orchestra.run.smithi096.stdout:running bootstrap script ... ok 2024-04-25T13:39:49.952 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T13:39:49.978 INFO:teuthology.orchestra.run.smithi191.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T13:39:50.004 INFO:teuthology.orchestra.run.smithi191.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T13:39:50.053 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout:This user must also own the server process. 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout:The default text search configuration will be set to "english". 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout:Data page checksums are disabled. 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:39:50.055 INFO:teuthology.orchestra.run.smithi191.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T13:39:50.056 INFO:teuthology.orchestra.run.smithi191.stdout:creating subdirectories ... ok 2024-04-25T13:39:50.056 INFO:teuthology.orchestra.run.smithi191.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T13:39:50.069 INFO:teuthology.orchestra.run.smithi191.stdout:selecting default max_connections ... 100 2024-04-25T13:39:50.090 INFO:teuthology.orchestra.run.smithi191.stdout:selecting default shared_buffers ... 128MB 2024-04-25T13:39:50.103 INFO:teuthology.orchestra.run.smithi191.stdout:selecting default time zone ... Etc/UTC 2024-04-25T13:39:50.104 INFO:teuthology.orchestra.run.smithi191.stdout:creating configuration files ... ok 2024-04-25T13:39:50.162 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:50.221 INFO:teuthology.orchestra.run.smithi191.stdout:running bootstrap script ... ok 2024-04-25T13:39:50.313 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:39:50.439 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:39:50.469 INFO:teuthology.orchestra.run.smithi096.stdout:performing post-bootstrap initialization ... ok 2024-04-25T13:39:50.959 INFO:teuthology.orchestra.run.smithi191.stdout:performing post-bootstrap initialization ... ok 2024-04-25T13:39:51.069 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:39:51.170 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T13:39:51.180 INFO:teuthology.orchestra.run.smithi096.stdout:syncing data to disk ... ok 2024-04-25T13:39:51.255 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T13:39:51.313 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:51.439 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:39:51.547 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T13:39:51.565 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T13:39:51.648 INFO:teuthology.orchestra.run.smithi191.stdout:syncing data to disk ... ok 2024-04-25T13:39:51.700 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T13:39:51.826 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:39:51.916 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T13:39:51.977 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:39:52.036 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T13:39:52.078 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:39:52.230 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:39:52.356 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:52.506 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T13:39:52.683 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T13:39:52.809 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:39:53.296 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:39:53.296 INFO:teuthology.orchestra.run.smithi151.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T13:39:53.296 INFO:teuthology.orchestra.run.smithi151.stdout:which means they are currently configured by ifupdown: 2024-04-25T13:39:53.296 INFO:teuthology.orchestra.run.smithi151.stdout:- enp3s0f1 2024-04-25T13:39:53.296 INFO:teuthology.orchestra.run.smithi151.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T13:39:53.296 INFO:teuthology.orchestra.run.smithi151.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T13:39:53.296 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:39:53.420 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T13:39:53.744 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T13:39:54.061 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T13:39:54.383 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:54.484 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T13:39:54.578 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:39:54.585 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up postgresql (14+238) ... 2024-04-25T13:39:54.711 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:54.713 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:39:54.792 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:54.839 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T13:39:54.855 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:54.917 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T13:39:54.965 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-common (238) ... 2024-04-25T13:39:55.035 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up postgresql (14+238) ... 2024-04-25T13:39:55.108 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:39:55.109 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:39:55.147 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:39:55.273 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:39:55.526 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:39:55.526 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:39:55.623 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:39:55.732 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T13:39:55.860 INFO:teuthology.orchestra.run.smithi151.stdout:Adding user postgres to group ssl-cert 2024-04-25T13:39:56.035 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:39:56.051 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:39:56.144 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T13:39:56.158 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:39:56.158 INFO:teuthology.orchestra.run.smithi151.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T13:39:56.179 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:39:56.353 INFO:teuthology.orchestra.run.smithi151.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T13:39:56.353 INFO:teuthology.orchestra.run.smithi151.stdout:Removing obsolete dictionary files: 2024-04-25T13:39:56.446 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:39:56.591 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:39:56.916 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T13:39:57.247 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T13:39:57.316 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:39:57.355 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:39:57.649 INFO:teuthology.orchestra.run.smithi151.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T13:39:57.660 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T13:39:57.719 INFO:teuthology.orchestra.run.smithi151.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout:This user must also own the server process. 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout:The default text search configuration will be set to "english". 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout:Data page checksums are disabled. 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout:creating subdirectories ... ok 2024-04-25T13:39:57.720 INFO:teuthology.orchestra.run.smithi151.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T13:39:57.735 INFO:teuthology.orchestra.run.smithi151.stdout:selecting default max_connections ... 100 2024-04-25T13:39:57.754 INFO:teuthology.orchestra.run.smithi151.stdout:selecting default shared_buffers ... 128MB 2024-04-25T13:39:57.764 INFO:teuthology.orchestra.run.smithi151.stdout:selecting default time zone ... Etc/UTC 2024-04-25T13:39:57.765 INFO:teuthology.orchestra.run.smithi151.stdout:creating configuration files ... ok 2024-04-25T13:39:57.820 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:39:57.825 DEBUG:teuthology.parallel:result is None 2024-04-25T13:39:57.876 INFO:teuthology.orchestra.run.smithi151.stdout:running bootstrap script ... ok 2024-04-25T13:39:57.948 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T13:39:58.056 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:39:58.523 INFO:teuthology.orchestra.run.smithi191.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:39:58.527 DEBUG:teuthology.parallel:result is None 2024-04-25T13:39:58.543 INFO:teuthology.orchestra.run.smithi151.stdout:performing post-bootstrap initialization ... ok 2024-04-25T13:39:59.262 INFO:teuthology.orchestra.run.smithi151.stdout:syncing data to disk ... ok 2024-04-25T13:39:59.665 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T13:40:02.531 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:02.631 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T13:40:02.758 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql (14+238) ... 2024-04-25T13:40:02.884 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:03.010 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:40:03.263 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:40:03.263 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:40:03.829 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:40:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T13:40:04.232 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:40:04.367 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:40:05.737 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T13:40:05.836 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:40:06.360 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:40:06.365 DEBUG:teuthology.parallel:result is None 2024-04-25T13:40:06.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:40:06.596 DEBUG:teuthology.orchestra.run.smithi077:> dpkg-query -W -f '${Version}' ceph 2024-04-25T13:40:06.615 INFO:teuthology.orchestra.run.smithi077.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:06.616 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:06.616 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T13:40:06.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:40:06.835 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2024-04-25T13:40:06.855 INFO:teuthology.orchestra.run.smithi096.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:06.855 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:06.855 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T13:40:06.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:40:07.003 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2024-04-25T13:40:07.023 INFO:teuthology.orchestra.run.smithi097.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:07.023 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:07.023 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T13:40:07.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:40:07.251 DEBUG:teuthology.orchestra.run.smithi151:> dpkg-query -W -f '${Version}' ceph 2024-04-25T13:40:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:07.271 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:07.271 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T13:40:07.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:40:07.414 DEBUG:teuthology.orchestra.run.smithi191:> dpkg-query -W -f '${Version}' ceph 2024-04-25T13:40:07.433 INFO:teuthology.orchestra.run.smithi191.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:07.433 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:40:07.433 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T13:40:07.434 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T13:40:07.435 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:07.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:40:07.449 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:07.449 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:40:07.463 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:40:07.463 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:40:07.478 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:40:07.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:40:07.492 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:40:07.492 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:40:07.506 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T13:40:07.506 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:07.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:40:07.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:40:07.574 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:07.574 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:40:07.587 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:40:07.642 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:40:07.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:40:07.656 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:40:07.710 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:40:07.711 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:40:07.724 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:40:07.777 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:40:07.778 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:40:07.792 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:40:07.845 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T13:40:07.845 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:07.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:40:07.859 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:40:07.912 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:07.912 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:40:07.926 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:40:07.982 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:40:07.982 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:40:07.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:40:08.051 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:40:08.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:40:08.065 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:40:08.121 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:40:08.121 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:40:08.134 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:40:08.187 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T13:40:08.187 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:08.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:40:08.201 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:40:08.255 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:08.256 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:40:08.269 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:40:08.321 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:40:08.321 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:40:08.335 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:40:08.393 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:40:08.415 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:40:08.428 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:40:08.485 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:40:08.485 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:40:08.499 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:40:08.552 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T13:40:08.630 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T13:40:08.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2024-04-25T13:40:08.633 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-04-25T13:40:08.635 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-04-25T13:40:08.637 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-04-25T13:40:08.640 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2024-04-25T13:40:08.652 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T13:40:08.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:40:08.689 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:40:08.692 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:40:08.694 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:40:08.697 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:40:08.708 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T13:40:08.708 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:40:08.741 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:40:08.748 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:40:08.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:40:08.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:40:08.771 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T13:40:08.772 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T13:40:08.772 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T13:40:08.772 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:08.772 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:40:08.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:08.875 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:08.875 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:40:08.881 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:08.954 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:40:08.954 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:40:08.960 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:09.034 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:40:09.034 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:40:09.040 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:09.113 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:40:09.113 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:40:09.119 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:09.197 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T13:40:09.197 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T13:40:09.198 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/mdtest}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673167', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNB1gK2Rz7GR7V46BAlFT2z9wBUgRkRll4H5UxK9mI4aFkg/bXaCJLoCwi3DVxiiR/npzETWCiLIxWfOHrzICLk=', 'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGkwrDHxjAsHUMPe5TIAwsjHmJGrG7n/YR+QSRfUyWJrAC+Sk59+AZY2XuyT0dXVIn94QHYLeB6ut5oCi+ADaQo=', 'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI6wALdQJpDmyF6rJs4MvFMTAi2oI6/8R+ByX9gZClNKQootgrvHtGByp6g+AQy8Yahvl4Ic2eivG2nhY54AHug=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7fXcopA+J/wquQ+J9askOazGSyzV7zl4ynG3zRdy9IjzVb1Q6wCaqCVA0rqaxO3hA0O9pOFcZnz66qc/GTze4=', 'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAKkyKBRGdbeAQ3YtkCY15z1MGdRAjlioV7NFtvuxpIBjyf9bBHCJPhi1pkzjHfcYVzlIsVXtKoLcuL1PrrVGso='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'pexec': {'clients': ['set -x', 'cd $TESTDIR', 'sudo apt purge -y mpich', 'sudo apt install -y mpich', 'wget http://download.ceph.com/qa/ior-3.3.0.tar.bz2', 'tar xvfj ior-3.3.0.tar.bz2', 'cd ior-3.3.0', './configure', 'make', 'make install DESTDIR=$TESTDIR/binary/', 'cd $TESTDIR/', 'sudo apt install -y tree', 'tree binary/', 'rm ior-3.3.0.tar.bz2', 'rm -r ior-3.3.0', 'ln -s $TESTDIR/mnt.* $TESTDIR/gmnt']}}, {'ssh_keys': None}, {'mpi': {'exec': '$TESTDIR/binary/usr/local/bin/mdtest -d $TESTDIR/gmnt -I 20 -z 5 -b 2 -R'}}, {'pexec': {'clients': ['rm -f $TESTDIR/gmnt/ior.testfile', 'rm -f $TESTDIR/gmnt', 'rm -rf $TESTDIR/binary']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T13:40:09.198 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:40:09.201 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:40:09.203 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:40:09.206 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:40:09.209 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:40:09.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:40:09.249 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:40:09.252 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:40:09.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:40:09.259 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:40:09.300 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:09.300 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:40:09.308 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:40:09.308 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-04-25T13:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-04-25T13:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 13:33:19.819799040 +0000 2024-04-25T13:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 13:33:19.527801648 +0000 2024-04-25T13:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 13:33:19.527801648 +0000 2024-04-25T13:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2024-04-25T13:40:09.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:40:09.410 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T13:40:09.410 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T13:40:09.410 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000385549 s, 1.3 MB/s 2024-04-25T13:40:09.411 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:40:09.461 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-04-25T13:40:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:40:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:40:09.508 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-04-25T13:40:09.508 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:40:09.508 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 13:33:20.335794431 +0000 2024-04-25T13:40:09.508 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 13:33:20.051796968 +0000 2024-04-25T13:40:09.508 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 13:33:20.051796968 +0000 2024-04-25T13:40:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2024-04-25T13:40:09.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:40:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T13:40:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T13:40:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000317718 s, 1.6 MB/s 2024-04-25T13:40:09.563 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:40:09.613 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-04-25T13:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-04-25T13:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 13:33:20.819790108 +0000 2024-04-25T13:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 13:33:20.551792502 +0000 2024-04-25T13:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 13:33:20.551792502 +0000 2024-04-25T13:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2024-04-25T13:40:09.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:40:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T13:40:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T13:40:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000352061 s, 1.5 MB/s 2024-04-25T13:40:09.716 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:40:09.765 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-04-25T13:40:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:40:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:40:09.812 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-04-25T13:40:09.812 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:40:09.812 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 13:33:21.071787857 +0000 2024-04-25T13:40:09.812 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 13:33:21.067787893 +0000 2024-04-25T13:40:09.812 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 13:33:21.067787893 +0000 2024-04-25T13:40:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2024-04-25T13:40:09.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:40:09.866 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T13:40:09.866 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T13:40:09.866 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000348307 s, 1.5 MB/s 2024-04-25T13:40:09.867 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:40:09.917 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:09.917 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:09.917 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:40:09.923 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:40:09.923 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-04-25T13:40:09.971 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:40:09.971 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:40:09.971 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-04-25T13:40:09.971 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:40:09.971 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-25 13:33:21.260333491 +0000 2024-04-25T13:40:09.971 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-25 13:33:21.256333527 +0000 2024-04-25T13:40:09.972 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-25 13:33:21.256333527 +0000 2024-04-25T13:40:09.972 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-25T13:40:09.972 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:40:10.026 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-25T13:40:10.026 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-25T13:40:10.026 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000453523 s, 1.1 MB/s 2024-04-25T13:40:10.028 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:40:10.076 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-04-25T13:40:10.123 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:40:10.123 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:40:10.123 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-04-25T13:40:10.123 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:40:10.123 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-25 13:33:22.012326775 +0000 2024-04-25T13:40:10.123 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-25 13:33:21.736329240 +0000 2024-04-25T13:40:10.123 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-25 13:33:21.736329240 +0000 2024-04-25T13:40:10.123 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-25T13:40:10.123 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:40:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-25T13:40:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-25T13:40:10.177 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000439579 s, 1.2 MB/s 2024-04-25T13:40:10.178 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:40:10.228 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-04-25T13:40:10.275 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:40:10.275 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:40:10.275 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-04-25T13:40:10.275 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:40:10.275 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-25 13:33:22.496322452 +0000 2024-04-25T13:40:10.275 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-25 13:33:22.232324810 +0000 2024-04-25T13:40:10.276 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-25 13:33:22.232324810 +0000 2024-04-25T13:40:10.276 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-25T13:40:10.276 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:40:10.330 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-25T13:40:10.330 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-25T13:40:10.330 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.00032722 s, 1.6 MB/s 2024-04-25T13:40:10.331 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:40:10.380 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-04-25T13:40:10.427 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:40:10.427 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:40:10.427 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-25T13:40:10.428 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:40:10.428 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-04-25 13:33:23.008317878 +0000 2024-04-25T13:40:10.428 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-04-25 13:33:22.752320164 +0000 2024-04-25T13:40:10.428 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-04-25 13:33:22.752320164 +0000 2024-04-25T13:40:10.428 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-04-25T13:40:10.428 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:40:10.481 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-04-25T13:40:10.482 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-04-25T13:40:10.482 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.00038045 s, 1.3 MB/s 2024-04-25T13:40:10.483 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:40:10.532 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:10.533 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:40:10.533 INFO:tasks.ceph:Generating config... 2024-04-25T13:40:10.534 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T13:40:10.534 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T13:40:10.534 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T13:40:10.534 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T13:40:10.535 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T13:40:10.535 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T13:40:10.536 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T13:40:10.536 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T13:40:10.536 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T13:40:10.536 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T13:40:10.536 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T13:40:10.536 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T13:40:10.536 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T13:40:10.536 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T13:40:10.536 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T13:40:10.536 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-25T13:40:10.536 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T13:40:10.536 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T13:40:10.537 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T13:40:10.538 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T13:40:10.538 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T13:40:10.603 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T13:40:10.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T13:40:10.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:40:10.697 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.77'), ('mon.b', '172.21.15.96'), ('mon.c', '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]')] 2024-04-25T13:40:10.698 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.77,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T13:40:10.698 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:10.698 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:40:10.743 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.77 --add b 172.21.15.96 --addv c '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:10.852 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:10.852 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: generated fsid 137a8595-336b-48a1-94de-86eaa6851f1a 2024-04-25T13:40:10.852 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = quincy 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 0 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 137a8595-336b-48a1-94de-86eaa6851f1a 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:last_changed 2024-04-25T13:40:10.857528+0000 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T13:40:10.857528+0000 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:min_mon_release 17 (quincy) 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:election_strategy: 1 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:1: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.b 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:2: [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] mon.c 2024-04-25T13:40:10.853 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T13:40:10.858 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:40:10.863 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 137a8595-336b-48a1-94de-86eaa6851f1a... 2024-04-25T13:40:10.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:40:10.909 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:40:10.911 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:40:10.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:40:10.916 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:40:10.933 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-04-25T13:40:10.933 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-04-25T13:40:10.933 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:40:10.933 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-04-25T13:40:10.933 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:40:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.935 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.77,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 137a8595-336b-48a1-94de-86eaa6851f1a 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-04-25T13:40:10.936 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:40:10.937 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore compression mode = aggressive 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2024-04-25T13:40:10.938 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-04-25T13:40:10.939 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.940 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:40:10.941 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-04-25T13:40:10.942 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = True 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.943 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.944 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-04-25T13:40:10.944 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-04-25T13:40:10.944 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:40:10.944 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-04-25T13:40:10.944 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.944 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-04-25T13:40:10.944 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.945 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:40:10.946 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.77,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = 137a8595-336b-48a1-94de-86eaa6851f1a 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-04-25T13:40:10.947 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-04-25T13:40:10.948 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore compression mode = aggressive 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 20 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 20 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-04-25T13:40:10.949 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 10 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.950 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:40:10.951 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: mon down mkfs grace = 300 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-04-25T13:40:10.952 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-04-25T13:40:10.953 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds balancer = 20 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = True 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = True 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:40:10.955 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-04-25T13:40:10.956 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.77,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 137a8595-336b-48a1-94de-86eaa6851f1a 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.957 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug trim objects = true 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:40:10.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression mode = aggressive 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 20 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 20 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-04-25T13:40:10.959 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 10 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-04-25T13:40:10.960 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:40:10.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: mon down mkfs grace = 300 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: mon op complaint time = 120 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-04-25T13:40:10.962 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: client mount timeout = 600 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout:[mds] 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds = 20 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds balancer = 20 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-25T13:40:10.963 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug frag = True 2024-04-25T13:40:10.964 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug scatterstat = True 2024-04-25T13:40:10.964 INFO:teuthology.orchestra.run.smithi096.stdout: mds op complaint time = 180 2024-04-25T13:40:10.964 INFO:teuthology.orchestra.run.smithi096.stdout: mds verify scatter = True 2024-04-25T13:40:10.964 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-04-25T13:40:10.964 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.964 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.966 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.967 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:40:10.968 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.77,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = 137a8595-336b-48a1-94de-86eaa6851f1a 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.969 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug trim objects = true 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2024-04-25T13:40:10.970 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore compression mode = aggressive 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2024-04-25T13:40:10.971 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 20 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 20 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 10 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2024-04-25T13:40:10.972 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2024-04-25T13:40:10.973 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:40:10.974 INFO:teuthology.orchestra.run.smithi191.stdout: mon down mkfs grace = 300 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2024-04-25T13:40:10.975 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds balancer = 20 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = True 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = True 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-04-25T13:40:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-04-25T13:40:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.77,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 137a8595-336b-48a1-94de-86eaa6851f1a 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-04-25T13:40:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore compression mode = aggressive 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 20 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 20 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-04-25T13:40:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 10 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-04-25T13:40:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-04-25T13:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: mon down mkfs grace = 300 2024-04-25T13:40:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2024-04-25T13:40:10.985 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2024-04-25T13:40:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2024-04-25T13:40:10.987 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T13:40:10.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T13:40:11.091 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T13:40:11.092 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:11.092 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T13:40:11.097 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:11.097 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T13:40:11.143 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:40:11.144 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:11.144 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:40:11.144 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:40:11.206 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:11.206 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:11.252 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:40:11.252 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:11.252 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:40:11.252 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:40:11.275 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:11.275 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:11.323 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-04-25T13:40:11.323 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:40:11.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:40:11.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:40:11.347 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:40:11.347 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:11.396 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T13:40:11.397 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:40:11.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:40:11.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:40:11.420 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:40:11.421 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:11.469 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:40:11.469 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:40:11.469 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:40:11.469 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:40:11.493 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:40:11.493 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:11.541 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T13:40:11.541 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T13:40:11.541 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:40:11.615 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:40:11.621 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:40:11.695 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:40:11.709 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T13:40:11.709 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:40:11.780 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:40:11.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T13:40:11.800 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:40:11.870 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:40:11.877 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T13:40:11.890 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T13:40:11.891 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T13:40:11.957 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T13:40:11.975 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T13:40:12.041 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T13:40:12.071 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T13:40:12.137 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T13:40:12.153 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T13:40:12.154 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:40:12.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T13:40:12.168 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:12.168 INFO:tasks.ceph:role: osd.0 2024-04-25T13:40:12.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:40:12.168 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:40:12.230 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:40:12.231 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:40:12.231 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:40:12.231 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:40:12.231 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:40:12.231 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:40:12.231 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:40:12.231 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:40:12.231 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:40:12.231 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:40:12.676 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-25T13:40:12.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-25T13:40:12.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T13:40:12.763 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T13:40:12.816 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:40:12.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:40:12.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T13:40:12.872 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:12.872 INFO:tasks.ceph:role: osd.1 2024-04-25T13:40:12.872 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:40:12.872 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:40:12.936 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:40:12.937 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:40:12.937 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:40:12.937 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:40:12.937 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:40:12.937 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:40:12.937 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:40:12.937 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:40:12.937 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:40:12.937 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:40:13.429 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-25T13:40:13.431 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-25T13:40:13.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T13:40:13.586 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T13:40:13.596 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:40:13.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:40:13.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T13:40:13.652 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:13.652 INFO:tasks.ceph:role: osd.2 2024-04-25T13:40:13.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:40:13.652 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:40:13.716 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:40:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:40:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:40:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:40:13.716 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:40:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:40:13.716 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:40:13.716 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:40:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:40:13.717 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:40:14.215 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-25T13:40:14.218 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-25T13:40:14.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T13:40:14.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T13:40:14.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:40:14.380 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:40:14.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T13:40:14.435 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:14.435 INFO:tasks.ceph:role: osd.3 2024-04-25T13:40:14.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:40:14.436 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:40:14.500 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:40:14.500 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:40:14.500 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:40:14.500 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:40:14.500 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:40:14.500 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:40:14.500 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:40:14.500 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:40:14.500 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:40:14.501 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:40:14.944 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-25T13:40:14.946 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-25T13:40:14.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T13:40:15.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T13:40:15.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:40:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:40:15.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:15.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:15.211+0000 7f71456337c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T13:40:15.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:15.211+0000 7f71456337c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T13:40:15.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:15.211+0000 7f71456337c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:40:15.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:15.211+0000 7f71456337c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:40:15.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:15.211+0000 7f71456337c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:40:15.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:15.215+0000 7f71456337c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T13:40:18.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T13:40:18.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:18.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:18.318+0000 7ff976cfc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T13:40:18.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:18.318+0000 7ff976cfc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T13:40:18.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:18.318+0000 7ff976cfc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:40:18.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:18.318+0000 7ff976cfc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:40:18.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:18.318+0000 7ff976cfc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:40:18.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:18.318+0000 7ff976cfc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T13:40:21.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T13:40:21.319 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:21.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:21.426+0000 7efeec8bc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T13:40:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:21.426+0000 7efeec8bc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T13:40:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:21.426+0000 7efeec8bc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:40:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:21.426+0000 7efeec8bc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:40:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:21.426+0000 7efeec8bc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:40:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:21.430+0000 7efeec8bc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T13:40:24.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T13:40:24.430 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:24.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:24.546+0000 7ff9f4e657c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T13:40:24.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:24.550+0000 7ff9f4e657c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T13:40:24.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:24.550+0000 7ff9f4e657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:40:24.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:24.550+0000 7ff9f4e657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:40:24.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:24.550+0000 7ff9f4e657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:40:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:24.550+0000 7ff9f4e657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T13:40:27.536 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T13:40:27.551 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T13:40:27.566 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:27.566 INFO:tasks.ceph:role: osd.4 2024-04-25T13:40:27.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:40:27.566 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:40:27.630 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:40:27.630 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:40:27.630 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:40:27.630 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:40:27.630 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:40:27.630 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:40:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:40:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:40:27.631 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:40:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:40:28.086 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-25T13:40:28.088 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-25T13:40:28.088 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T13:40:28.220 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T13:40:28.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:40:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:40:28.233 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T13:40:28.286 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:28.287 INFO:tasks.ceph:role: osd.5 2024-04-25T13:40:28.287 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:40:28.287 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:40:28.352 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:40:28.352 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:40:28.352 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:40:28.352 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:40:28.352 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:40:28.352 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:40:28.353 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:40:28.353 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:40:28.353 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:40:28.353 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:40:28.835 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-25T13:40:28.837 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-25T13:40:28.837 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T13:40:28.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T13:40:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:40:29.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:40:29.003 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T13:40:29.059 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:29.059 INFO:tasks.ceph:role: osd.6 2024-04-25T13:40:29.059 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:40:29.059 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:40:29.122 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:40:29.122 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:40:29.122 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:40:29.122 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:40:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:40:29.123 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:40:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:40:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:40:29.123 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:40:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:40:29.590 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-25T13:40:29.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-25T13:40:29.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T13:40:29.737 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T13:40:29.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:40:29.749 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:40:29.749 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T13:40:29.803 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:40:29.803 INFO:tasks.ceph:role: osd.7 2024-04-25T13:40:29.803 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:40:29.803 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:40:29.865 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:40:29.866 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:40:29.866 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:40:29.866 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:40:29.866 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:40:29.866 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:40:29.866 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:40:29.866 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:40:29.866 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:40:29.866 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:40:30.296 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-04-25T13:40:30.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-04-25T13:40:30.299 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T13:40:30.406 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T13:40:30.415 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:40:30.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:40:30.416 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:30.562+0000 7f3a1bb787c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T13:40:30.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:30.566+0000 7f3a1bb787c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T13:40:30.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:30.566+0000 7f3a1bb787c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:40:30.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:30.566+0000 7f3a1bb787c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:40:30.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:30.566+0000 7f3a1bb787c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:40:30.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:30.574+0000 7f3a1bb787c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T13:40:33.547 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T13:40:33.560 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:33.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:33.670+0000 7f3a31d997c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T13:40:33.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:33.670+0000 7f3a31d997c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T13:40:33.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:33.670+0000 7f3a31d997c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:40:33.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:33.670+0000 7f3a31d997c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:40:33.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:33.670+0000 7f3a31d997c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:40:33.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:33.674+0000 7f3a31d997c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T13:40:36.662 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T13:40:36.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:36.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:36.786+0000 7f7ff99847c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T13:40:36.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:36.786+0000 7f7ff99847c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T13:40:36.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:36.786+0000 7f7ff99847c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:40:36.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:36.786+0000 7f7ff99847c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:40:36.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:36.786+0000 7f7ff99847c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:40:36.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:36.786+0000 7f7ff99847c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T13:40:39.200 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:39.232 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:39.234 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:39.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:39.240 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:40:39.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T13:40:39.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:39.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:39.898+0000 7fe702d537c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T13:40:39.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:39.898+0000 7fe702d537c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T13:40:39.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:39.898+0000 7fe702d537c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:40:39.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:39.898+0000 7fe702d537c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:40:39.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:39.898+0000 7fe702d537c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:40:39.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:39.898+0000 7fe702d537c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T13:40:42.872 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T13:40:42.884 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T13:40:42.884 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:42.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T13:40:42.898 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:42.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T13:40:42.954 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:42.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T13:40:43.010 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:43.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T13:40:43.065 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:43.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T13:40:43.121 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:43.121 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T13:40:43.174 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:43.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T13:40:43.187 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:43.187 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T13:40:43.241 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:43.242 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T13:40:43.301 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:43.301 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T13:40:43.354 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:43.354 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T13:40:43.410 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:43.410 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T13:40:43.466 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:40:43.466 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T13:40:43.472 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:40:43.472 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T13:40:43.478 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:40:43.479 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T13:40:43.484 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T13:40:43.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:40:43.487 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:40:43.512 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2024-04-25T13:40:43.512 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA7XSpmrNj0JBAAt/uKrxtHFfUX97i7Jorbxw== 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA7XSpmt63ULhAAen+C3b7/VW90Na+E1zp97A== 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA/XSpm+TK/DBAAGyI9bZTq2py7ryEJCu1Ixg== 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBCXSpmNL0zExAAyL7d8zfj94nu67Ftb9GczA== 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBFXSpmXNi6GRAANJLlcgDVmQqYyh12hKKPyg== 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBIXSpmZGvrIBAA//5D6gdoOFqIInsY2kWsEA== 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA7XSpmNI+dKRAAMof9/vTobv4b4okQT6UDcw== 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA7XSpmxXsYNBAAduqM0vZHvJegANxzEQ8rww== 2024-04-25T13:40:43.513 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBOXSpmE7fhIRAAZdrqZ2VUF3E93pLBtZSAqA== 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBRXSpmqpRWKBAAVCGDk13R1Tl2dy2Qj0OWgw== 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBUXSpmh28qLxAAmFR9cnDtlBUi/lNZ/qI3Tg== 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBXXSpmVCLTNRAAdc0GGlR+tr7XO/t7hZt7iQ== 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA7XSpmvZA1ORAA98PS25W+fm157X/rtmL53A== 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA8XSpmXF6KAhAAS9fIEAndI1DoWf1otGF6dg== 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout:[client.2] 2024-04-25T13:40:43.514 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA8XSpmdTZOCBAAha8eOdAlEIdng5uPehCbtg== 2024-04-25T13:40:43.521 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2024-04-25T13:40:43.521 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA7XSpmrNj0JBAAt/uKrxtHFfUX97i7Jorbxw== 2024-04-25T13:40:43.521 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-25T13:40:43.521 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA7XSpmt63ULhAAen+C3b7/VW90Na+E1zp97A== 2024-04-25T13:40:43.521 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2024-04-25T13:40:43.521 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA/XSpm+TK/DBAAGyI9bZTq2py7ryEJCu1Ixg== 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBCXSpmNL0zExAAyL7d8zfj94nu67Ftb9GczA== 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBFXSpmXNi6GRAANJLlcgDVmQqYyh12hKKPyg== 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBIXSpmZGvrIBAA//5D6gdoOFqIInsY2kWsEA== 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA7XSpmNI+dKRAAMof9/vTobv4b4okQT6UDcw== 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA7XSpmxXsYNBAAduqM0vZHvJegANxzEQ8rww== 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.4] 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBOXSpmE7fhIRAAZdrqZ2VUF3E93pLBtZSAqA== 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.5] 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBRXSpmqpRWKBAAVCGDk13R1Tl2dy2Qj0OWgw== 2024-04-25T13:40:43.522 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.6] 2024-04-25T13:40:43.523 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBUXSpmh28qLxAAmFR9cnDtlBUi/lNZ/qI3Tg== 2024-04-25T13:40:43.523 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.7] 2024-04-25T13:40:43.523 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBXXSpmVCLTNRAAdc0GGlR+tr7XO/t7hZt7iQ== 2024-04-25T13:40:43.523 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-04-25T13:40:43.523 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA7XSpmvZA1ORAA98PS25W+fm157X/rtmL53A== 2024-04-25T13:40:43.523 INFO:teuthology.orchestra.run.smithi096.stdout:[client.1] 2024-04-25T13:40:43.523 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA8XSpmXF6KAhAAS9fIEAndI1DoWf1otGF6dg== 2024-04-25T13:40:43.523 INFO:teuthology.orchestra.run.smithi096.stdout:[client.2] 2024-04-25T13:40:43.523 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA8XSpmdTZOCBAAha8eOdAlEIdng5uPehCbtg== 2024-04-25T13:40:43.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:40:43.559 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:40:43.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:40:43.646 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:40:43.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:43.723 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:43.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:43.797 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:43.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:43.872 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:43.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:43.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:44.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:40:44.017 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:40:44.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:40:44.091 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:40:44.163 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:44.165 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:44.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:44.240 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:44.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:44.316 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:44.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:44.386 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:40:44.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:40:44.458 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:40:44.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:40:44.537 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:40:44.608 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:40:44.610 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:40:44.681 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T13:40:44.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T13:40:44.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:40:44.809 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T13:40:44.818 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T13:40:44.832 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:40:44.959 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T13:40:44.969 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T13:40:45.020 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:40:45.144 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T13:40:45.154 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:45.156 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:40:45.201 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T13:40:45.202 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T13:40:45.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T13:40:45.204 INFO:tasks.ceph.mon.a:Started 2024-04-25T13:40:45.204 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T13:40:45.204 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T13:40:45.247 INFO:tasks.ceph.mon.b:Started 2024-04-25T13:40:45.247 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T13:40:45.248 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T13:40:45.250 INFO:tasks.ceph.mon.c:Started 2024-04-25T13:40:45.250 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T13:40:45.250 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T13:40:45.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T13:40:45.252 INFO:tasks.ceph.mgr.y:Started 2024-04-25T13:40:45.252 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T13:40:45.252 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T13:40:45.254 INFO:tasks.ceph.mgr.x:Started 2024-04-25T13:40:45.254 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T13:40:45.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T13:40:45.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.400+0000 7fe341ce8640 1 Processor -- start 2024-04-25T13:40:45.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.400+0000 7fe341ce8640 1 -- start start 2024-04-25T13:40:45.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe341ce8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:45.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe341ce8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:45.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe341ce8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:45.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe341ce8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe33c154530 con 0x7fe33c14d350 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe341ce8640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe33c0aa880 con 0x7fe33c074690 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe341ce8640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c0aadb0 con 0x7fe33c070e10 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56776/0 (socket says 172.21.15.77:56776) 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33affd640 1 -- 172.21.15.77:0/757732106 learned_addr learned my addr 172.21.15.77:0/757732106 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33bfff640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33affd640 1 -- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 msgr2=0x7fe33c14d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33affd640 1 -- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 msgr2=0x7fe33c14d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33affd640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33affd640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33b7fe640 1 -- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 msgr2=0x7fe33c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33bfff640 1 -- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 msgr2=0x7fe33c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33b7fe640 1 -- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 msgr2=0x7fe33c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:40:45.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33bfff640 1 -- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 msgr2=0x7fe33c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:40:45.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:40:45.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33bfff640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:40:45.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:40:45.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.404+0000 7fe33bfff640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:40:45.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33affd640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:45.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33bfff640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:45.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:45.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33affd640 1 -- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 msgr2=0x7fe33c14d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:40:45.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33affd640 1 -- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 msgr2=0x7fe33c14d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33affd640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33affd640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33bfff640 1 -- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 msgr2=0x7fe33c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33bfff640 1 -- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 msgr2=0x7fe33c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33b7fe640 1 -- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 msgr2=0x7fe33c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33b7fe640 1 -- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 msgr2=0x7fe33c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33bfff640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33bfff640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:40:45.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:45.608+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:40:45.845 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:45.844+0000 7fd71d5d4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:40:45.919 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:45.918+0000 7fc485ee8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:40:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.012+0000 7fe33affd640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.77:3300/0 conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.012+0000 7fe33bfff640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.012+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.012+0000 7fe33affd640 1 -- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 msgr2=0x7fe33c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.012+0000 7fe33affd640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.012+0000 7fe33affd640 1 -- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 msgr2=0x7fe33c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.012+0000 7fe33affd640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.012+0000 7fe33affd640 1 -- 172.21.15.77:0/757732106 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c0aaad0 con 0x7fe33c14d350 2024-04-25T13:40:46.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.016+0000 7fe33affd640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c14d350 0x7fe33c14d760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe33c074620 tx=0x7fe33001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2425eb945a837d28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:46.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.016+0000 7fe33a7fc640 1 -- 172.21.15.77:0/757732106 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3300ab070 con 0x7fe33c14d350 2024-04-25T13:40:46.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.016+0000 7fe33a7fc640 1 -- 172.21.15.77:0/757732106 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3300a5920 con 0x7fe33c14d350 2024-04-25T13:40:46.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.016+0000 7fe33a7fc640 1 -- 172.21.15.77:0/757732106 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33000f040 con 0x7fe33c14d350 2024-04-25T13:40:46.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.020+0000 7fe341ce8640 1 -- 172.21.15.77:0/757732106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c14d350 msgr2=0x7fe33c14d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.020+0000 7fe341ce8640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c14d350 0x7fe33c14d760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe33c074620 tx=0x7fe33001ca80 comp rx=0 tx=0).stop 2024-04-25T13:40:46.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.020+0000 7fe341ce8640 1 -- 172.21.15.77:0/757732106 shutdown_connections 2024-04-25T13:40:46.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.020+0000 7fe341ce8640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c070e10 0x7fe33c071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.020+0000 7fe341ce8640 1 --2- 172.21.15.77:0/757732106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c14d350 0x7fe33c14d760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.020+0000 7fe341ce8640 1 --2- 172.21.15.77:0/757732106 >> v2:172.21.15.96:3300/0 conn(0x7fe33c074690 0x7fe33c073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.020+0000 7fe341ce8640 1 -- 172.21.15.77:0/757732106 >> 172.21.15.77:0/757732106 conn(0x7fe33c0a7d80 msgr2=0x7fe33c0c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:46.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.020+0000 7fe341ce8640 1 -- 172.21.15.77:0/757732106 shutdown_connections 2024-04-25T13:40:46.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.020+0000 7fe341ce8640 1 -- 172.21.15.77:0/757732106 wait complete. 2024-04-25T13:40:46.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 Processor -- start 2024-04-25T13:40:46.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 -- start start 2024-04-25T13:40:46.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c070e10 0x7fe33c149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c074690 0x7fe33c14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe33c14d350 0x7fe33c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c150c50 con 0x7fe33c070e10 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c150ad0 con 0x7fe33c14d350 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c150dd0 con 0x7fe33c074690 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c070e10 0x7fe33c149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c070e10 0x7fe33c149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56818/0 (socket says 172.21.15.77:56818) 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33b7fe640 1 -- 172.21.15.77:0/3249521926 learned_addr learned my addr 172.21.15.77:0/3249521926 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33affd640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c074690 0x7fe33c14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33bfff640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe33c14d350 0x7fe33c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33b7fe640 1 -- 172.21.15.77:0/3249521926 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c074690 msgr2=0x7fe33c14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c074690 0x7fe33c14f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33b7fe640 1 -- 172.21.15.77:0/3249521926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe33c14d350 msgr2=0x7fe33c15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe33c14d350 0x7fe33c15a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33b7fe640 1 -- 172.21.15.77:0/3249521926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c1ed8b0 con 0x7fe33c070e10 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33bfff640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe33c14d350 0x7fe33c15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe33b7fe640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c070e10 0x7fe33c149860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0126f0 tx=0x7fe32c012bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe323fff640 1 -- 172.21.15.77:0/3249521926 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c01b070 con 0x7fe33c070e10 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe323fff640 1 -- 172.21.15.77:0/3249521926 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32c010830 con 0x7fe33c070e10 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 -- 172.21.15.77:0/3249521926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c1edb90 con 0x7fe33c070e10 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe323fff640 1 -- 172.21.15.77:0/3249521926 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c010c00 con 0x7fe33c070e10 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe341ce8640 1 -- 172.21.15.77:0/3249521926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33c14f980 con 0x7fe33c070e10 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe323fff640 1 -- 172.21.15.77:0/3249521926 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe32c01e070 con 0x7fe33c070e10 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.024+0000 7fe323fff640 1 -- 172.21.15.77:0/3249521926 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe32c0157d0 con 0x7fe33c070e10 2024-04-25T13:40:46.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.028+0000 7fe341ce8640 1 -- 172.21.15.77:0/3249521926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33c06a1a0 con 0x7fe33c070e10 2024-04-25T13:40:46.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.036+0000 7fe323fff640 1 -- 172.21.15.77:0/3249521926 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe32c015a20 con 0x7fe33c070e10 2024-04-25T13:40:46.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.100+0000 7fe341ce8640 1 -- 172.21.15.77:0/3249521926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe33c0c46b0 con 0x7fe33c070e10 2024-04-25T13:40:46.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe323fff640 1 -- 172.21.15.77:0/3249521926 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe32c015c00 con 0x7fe33c070e10 2024-04-25T13:40:46.103 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2024-04-25T13:40:46.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe341ce8640 1 -- 172.21.15.77:0/3249521926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c070e10 msgr2=0x7fe33c149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe341ce8640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c070e10 0x7fe33c149860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0126f0 tx=0x7fe32c012bb0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe341ce8640 1 -- 172.21.15.77:0/3249521926 shutdown_connections 2024-04-25T13:40:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe341ce8640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe33c14d350 0x7fe33c15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe341ce8640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe33c074690 0x7fe33c14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe341ce8640 1 --2- 172.21.15.77:0/3249521926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe33c070e10 0x7fe33c149860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe341ce8640 1 -- 172.21.15.77:0/3249521926 >> 172.21.15.77:0/3249521926 conn(0x7fe33c0a7d80 msgr2=0x7fe33c0a8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe341ce8640 1 -- 172.21.15.77:0/3249521926 shutdown_connections 2024-04-25T13:40:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:46.104+0000 7fe341ce8640 1 -- 172.21.15.77:0/3249521926 wait complete. 2024-04-25T13:40:46.123 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T13:40:46.123 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T13:40:46.123 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:46.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T13:40:46.134 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:46.134 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T13:40:46.187 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:46.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T13:40:46.238 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:40:46.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T13:40:46.291 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:46.291 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T13:40:46.304 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:46.304 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T13:40:46.330 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:46.328+0000 7fd71d5d4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:40:46.358 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:46.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T13:40:46.389 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:46.386+0000 7fc485ee8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:40:46.401 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:40:46.401 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T13:40:46.454 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3 0 2024-04-25T13:40:46.524 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:46.524+0000 7fd71d5d4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:40:46.611 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:46.610+0000 7fc485ee8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:40:46.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02ff9f5640 1 Processor -- start 2024-04-25T13:40:46.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02ff9f5640 1 -- start start 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02ff9f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f02f8074690 0x7f02f8073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02ff9f5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02f814d350 0x7f02f814d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02ff9f5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8070e10 0x7f02f8071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02ff9f5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f02f8154530 con 0x7f02f8074690 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02ff9f5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f02f80aa880 con 0x7f02f814d350 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02ff9f5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f02f80aadb0 con 0x7f02f8070e10 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fdf92640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8070e10 0x7f02f8071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fcf90640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02f814d350 0x7f02f814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fdf92640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8070e10 0x7f02f8071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:35232/0 (socket says 172.21.15.96:35232) 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fcf90640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02f814d350 0x7f02f814d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42924/0 (socket says 172.21.15.96:42924) 2024-04-25T13:40:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fdf92640 1 -- 172.21.15.96:0/2890317645 learned_addr learned my addr 172.21.15.96:0/2890317645 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fd791640 1 --2- 172.21.15.96:0/2890317645 >> v2:172.21.15.77:3300/0 conn(0x7f02f8074690 0x7f02f8073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fdf92640 1 -- 172.21.15.96:0/2890317645 >> v2:172.21.15.96:3300/0 conn(0x7f02f814d350 msgr2=0x7f02f814d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fdf92640 1 --2- 172.21.15.96:0/2890317645 >> v2:172.21.15.96:3300/0 conn(0x7f02f814d350 0x7f02f814d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fdf92640 1 -- 172.21.15.96:0/2890317645 >> v2:172.21.15.77:3300/0 conn(0x7f02f8074690 msgr2=0x7f02f8073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fdf92640 1 --2- 172.21.15.96:0/2890317645 >> v2:172.21.15.77:3300/0 conn(0x7f02f8074690 0x7f02f8073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fdf92640 1 -- 172.21.15.96:0/2890317645 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f80aaad0 con 0x7f02f8070e10 2024-04-25T13:40:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fcf90640 1 --2- 172.21.15.96:0/2890317645 >> v2:172.21.15.96:3300/0 conn(0x7f02f814d350 0x7f02f814d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:40:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.650+0000 7f02fd791640 1 --2- 172.21.15.96:0/2890317645 >> v2:172.21.15.77:3300/0 conn(0x7f02f8074690 0x7f02f8073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:40:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02fdf92640 1 --2- 172.21.15.96:0/2890317645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8070e10 0x7f02f8071220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02f8072900 tx=0x7f02e801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f8fa67c61b9a094 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02f7fff640 1 -- 172.21.15.96:0/2890317645 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e80a56f0 con 0x7f02f8070e10 2024-04-25T13:40:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02f7fff640 1 -- 172.21.15.96:0/2890317645 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e80a5890 con 0x7f02f8070e10 2024-04-25T13:40:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02f7fff640 1 -- 172.21.15.96:0/2890317645 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e80a5c60 con 0x7f02f8070e10 2024-04-25T13:40:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2890317645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8070e10 msgr2=0x7f02f8071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 --2- 172.21.15.96:0/2890317645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8070e10 0x7f02f8071220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02f8072900 tx=0x7f02e801c960 comp rx=0 tx=0).stop 2024-04-25T13:40:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2890317645 shutdown_connections 2024-04-25T13:40:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 --2- 172.21.15.96:0/2890317645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8070e10 0x7f02f8071220 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 --2- 172.21.15.96:0/2890317645 >> v2:172.21.15.96:3300/0 conn(0x7f02f814d350 0x7f02f814d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 --2- 172.21.15.96:0/2890317645 >> v2:172.21.15.77:3300/0 conn(0x7f02f8074690 0x7f02f8073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2890317645 >> 172.21.15.96:0/2890317645 conn(0x7f02f80a7d80 msgr2=0x7f02f80c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:46.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2890317645 shutdown_connections 2024-04-25T13:40:46.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2890317645 wait complete. 2024-04-25T13:40:46.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 Processor -- start 2024-04-25T13:40:46.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.654+0000 7f02ff9f5640 1 -- start start 2024-04-25T13:40:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02ff9f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f8070e10 0x7f02f81529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02ff9f5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8074690 0x7f02f815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02ff9f5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f814d350 0x7f02f8145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02ff9f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8150c50 con 0x7f02f8070e10 2024-04-25T13:40:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02ff9f5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8150ad0 con 0x7f02f814d350 2024-04-25T13:40:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02ff9f5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f02f8150dd0 con 0x7f02f8074690 2024-04-25T13:40:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fcf90640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8074690 0x7f02f815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fdf92640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f814d350 0x7f02f8145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fcf90640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8074690 0x7f02f815a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:35240/0 (socket says 172.21.15.96:35240) 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fcf90640 1 -- 172.21.15.96:0/2329066551 learned_addr learned my addr 172.21.15.96:0/2329066551 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fd791640 1 --2- 172.21.15.96:0/2329066551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f8070e10 0x7f02f81529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fdf92640 1 -- 172.21.15.96:0/2329066551 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8074690 msgr2=0x7f02f815a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fdf92640 1 --2- 172.21.15.96:0/2329066551 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8074690 0x7f02f815a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fdf92640 1 -- 172.21.15.96:0/2329066551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f8070e10 msgr2=0x7f02f81529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fdf92640 1 --2- 172.21.15.96:0/2329066551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f8070e10 0x7f02f81529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fdf92640 1 -- 172.21.15.96:0/2329066551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f8156390 con 0x7f02f814d350 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fcf90640 1 --2- 172.21.15.96:0/2329066551 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8074690 0x7f02f815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02fdf92640 1 --2- 172.21.15.96:0/2329066551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f814d350 0x7f02f8145820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02e80ab000 tx=0x7f02e8019700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02f5ffb640 1 -- 172.21.15.96:0/2329066551 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8009510 con 0x7f02f814d350 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2329066551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f8156670 con 0x7f02f814d350 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02f5ffb640 1 -- 172.21.15.96:0/2329066551 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e80be070 con 0x7f02f814d350 2024-04-25T13:40:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02f5ffb640 1 -- 172.21.15.96:0/2329066551 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e80b88b0 con 0x7f02f814d350 2024-04-25T13:40:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2329066551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f8154d60 con 0x7f02f814d350 2024-04-25T13:40:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02f5ffb640 1 -- 172.21.15.96:0/2329066551 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f02e80b8a50 con 0x7f02f814d350 2024-04-25T13:40:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02f5ffb640 1 -- 172.21.15.96:0/2329066551 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f02e80c3a00 con 0x7f02f814d350 2024-04-25T13:40:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.658+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2329066551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f806a1a0 con 0x7f02f814d350 2024-04-25T13:40:46.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.662+0000 7f02f5ffb640 1 -- 172.21.15.96:0/2329066551 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f02e80165e0 con 0x7f02f814d350 2024-04-25T13:40:46.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.730+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2329066551 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3", "id": 0} v 0) -- 0x7f02f814da80 con 0x7f02f814d350 2024-04-25T13:40:46.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02f5ffb640 1 -- 172.21.15.96:0/2329066551 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f02e80a57f0 con 0x7f02f814d350 2024-04-25T13:40:46.739 INFO:teuthology.orchestra.run.smithi096.stdout:0 2024-04-25T13:40:46.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2329066551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f814d350 msgr2=0x7f02f8145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02ff9f5640 1 --2- 172.21.15.96:0/2329066551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f814d350 0x7f02f8145820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02e80ab000 tx=0x7f02e8019700 comp rx=0 tx=0).stop 2024-04-25T13:40:46.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2329066551 shutdown_connections 2024-04-25T13:40:46.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02ff9f5640 1 --2- 172.21.15.96:0/2329066551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02f814d350 0x7f02f8145820 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02ff9f5640 1 --2- 172.21.15.96:0/2329066551 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02f8074690 0x7f02f815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02ff9f5640 1 --2- 172.21.15.96:0/2329066551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f8070e10 0x7f02f81529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2329066551 >> 172.21.15.96:0/2329066551 conn(0x7f02f80a7d80 msgr2=0x7f02f80c4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:46.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2329066551 shutdown_connections 2024-04-25T13:40:46.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.738+0000 7f02ff9f5640 1 -- 172.21.15.96:0/2329066551 wait complete. 2024-04-25T13:40:46.759 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 36251241-cee4-477d-b5bd-9c4946cc3a52 1 2024-04-25T13:40:46.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f3295bec640 1 Processor -- start 2024-04-25T13:40:46.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f3295bec640 1 -- start start 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f3295bec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f32900a8bd0 0x7f3290073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f3295bec640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f329006fa90 0x7f329014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f3295bec640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f329014f2a0 con 0x7f329014ffe0 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f3295bec640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f32901535a0 con 0x7f32900a8bd0 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f3295bec640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f329014f580 con 0x7f329006fa90 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f328effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f329006fa90 0x7f329014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f328effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f329006fa90 0x7f329014faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42940/0 (socket says 172.21.15.96:42940) 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f328effd640 1 -- 172.21.15.96:0/3967687278 learned_addr learned my addr 172.21.15.96:0/3967687278 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f328f7fe640 1 --2- 172.21.15.96:0/3967687278 >> v2:172.21.15.77:3300/0 conn(0x7f32900a8bd0 0x7f3290073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f328effd640 1 -- 172.21.15.96:0/3967687278 >> v2:172.21.15.77:3300/0 conn(0x7f32900a8bd0 msgr2=0x7f3290073bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:46.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f328effd640 1 --2- 172.21.15.96:0/3967687278 >> v2:172.21.15.77:3300/0 conn(0x7f32900a8bd0 0x7f3290073bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f328effd640 1 -- 172.21.15.96:0/3967687278 >> v1:172.21.15.77:6789/0 conn(0x7f329014ffe0 legacy=0x7f329014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:46.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.902+0000 7f328effd640 1 -- 172.21.15.96:0/3967687278 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3290074130 con 0x7f329006fa90 2024-04-25T13:40:46.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f328effd640 1 --2- 172.21.15.96:0/3967687278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329006fa90 0x7f329014faa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3290072110 tx=0x7f328401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=137e3aaf3a851ae1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:46.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f328e7fc640 1 -- 172.21.15.96:0/3967687278 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32840b4070 con 0x7f329006fa90 2024-04-25T13:40:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f328e7fc640 1 -- 172.21.15.96:0/3967687278 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32840a7ba0 con 0x7f329006fa90 2024-04-25T13:40:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f328e7fc640 1 -- 172.21.15.96:0/3967687278 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32840af440 con 0x7f329006fa90 2024-04-25T13:40:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f3295bec640 1 -- 172.21.15.96:0/3967687278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329006fa90 msgr2=0x7f329014faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f3295bec640 1 --2- 172.21.15.96:0/3967687278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329006fa90 0x7f329014faa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3290072110 tx=0x7f328401ebb0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f3295bec640 1 -- 172.21.15.96:0/3967687278 shutdown_connections 2024-04-25T13:40:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f3295bec640 1 --2- 172.21.15.96:0/3967687278 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329006fa90 0x7f329014faa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f3295bec640 1 --2- 172.21.15.96:0/3967687278 >> v2:172.21.15.77:3300/0 conn(0x7f32900a8bd0 0x7f3290073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f3295bec640 1 -- 172.21.15.96:0/3967687278 >> 172.21.15.96:0/3967687278 conn(0x7f32900c4ae0 msgr2=0x7f32900c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f3295bec640 1 -- 172.21.15.96:0/3967687278 shutdown_connections 2024-04-25T13:40:46.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.906+0000 7f3295bec640 1 -- 172.21.15.96:0/3967687278 wait complete. 2024-04-25T13:40:46.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 Processor -- start 2024-04-25T13:40:46.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 -- start start 2024-04-25T13:40:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f329006fa90 0x7f32901ec660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32900a8bd0 0x7f3290148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f329014ffe0 0x7f329014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f329006cdc0 con 0x7f329006fa90 2024-04-25T13:40:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f329014f030 con 0x7f32900a8bd0 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f329006cf40 con 0x7f329014ffe0 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32900a8bd0 0x7f3290148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32900a8bd0 0x7f3290148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42956/0 (socket says 172.21.15.96:42956) 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f329014ffe0 0x7f329014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328effd640 1 -- 172.21.15.96:0/3759526244 learned_addr learned my addr 172.21.15.96:0/3759526244 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328f7fe640 1 --2- 172.21.15.96:0/3759526244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f329006fa90 0x7f32901ec660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328effd640 1 -- 172.21.15.96:0/3759526244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f329014ffe0 msgr2=0x7f329014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328effd640 1 --2- 172.21.15.96:0/3759526244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f329014ffe0 0x7f329014adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328effd640 1 -- 172.21.15.96:0/3759526244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f329006fa90 msgr2=0x7f32901ec660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328effd640 1 --2- 172.21.15.96:0/3759526244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f329006fa90 0x7f32901ec660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328effd640 1 -- 172.21.15.96:0/3759526244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329014ec10 con 0x7f32900a8bd0 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328f7fe640 1 --2- 172.21.15.96:0/3759526244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f329006fa90 0x7f32901ec660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:40:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f328effd640 1 --2- 172.21.15.96:0/3759526244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32900a8bd0 0x7f3290148580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f328400b2c0 tx=0x7f328401b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3277fff640 1 -- 172.21.15.96:0/3759526244 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32840bf070 con 0x7f32900a8bd0 2024-04-25T13:40:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3277fff640 1 -- 172.21.15.96:0/3759526244 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32840b6050 con 0x7f32900a8bd0 2024-04-25T13:40:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 -- 172.21.15.96:0/3759526244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3290148ac0 con 0x7f32900a8bd0 2024-04-25T13:40:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3277fff640 1 -- 172.21.15.96:0/3759526244 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32840b4030 con 0x7f32900a8bd0 2024-04-25T13:40:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 -- 172.21.15.96:0/3759526244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32901515b0 con 0x7f32900a8bd0 2024-04-25T13:40:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3277fff640 1 -- 172.21.15.96:0/3759526244 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f32840c2070 con 0x7f32900a8bd0 2024-04-25T13:40:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3277fff640 1 -- 172.21.15.96:0/3759526244 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f32840c4440 con 0x7f32900a8bd0 2024-04-25T13:40:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.910+0000 7f3295bec640 1 -- 172.21.15.96:0/3759526244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329006a1a0 con 0x7f32900a8bd0 2024-04-25T13:40:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.914+0000 7f3277fff640 1 -- 172.21.15.96:0/3759526244 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f32840187a0 con 0x7f32900a8bd0 2024-04-25T13:40:46.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.978+0000 7f3295bec640 1 -- 172.21.15.96:0/3759526244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "36251241-cee4-477d-b5bd-9c4946cc3a52", "id": 1} v 0) -- 0x7f329006a1a0 con 0x7f32900a8bd0 2024-04-25T13:40:46.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.986+0000 7f3277fff640 1 -- 172.21.15.96:0/3759526244 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "36251241-cee4-477d-b5bd-9c4946cc3a52", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f32840a7a60 con 0x7f32900a8bd0 2024-04-25T13:40:46.989 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-04-25T13:40:46.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.986+0000 7f3295bec640 1 -- 172.21.15.96:0/3759526244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32900a8bd0 msgr2=0x7f3290148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:46.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.986+0000 7f3295bec640 1 --2- 172.21.15.96:0/3759526244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32900a8bd0 0x7f3290148580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f328400b2c0 tx=0x7f328401b950 comp rx=0 tx=0).stop 2024-04-25T13:40:46.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.990+0000 7f3295bec640 1 -- 172.21.15.96:0/3759526244 shutdown_connections 2024-04-25T13:40:46.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.990+0000 7f3295bec640 1 --2- 172.21.15.96:0/3759526244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f329014ffe0 0x7f329014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.990+0000 7f3295bec640 1 --2- 172.21.15.96:0/3759526244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32900a8bd0 0x7f3290148580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.990+0000 7f3295bec640 1 --2- 172.21.15.96:0/3759526244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f329006fa90 0x7f32901ec660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:46.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.990+0000 7f3295bec640 1 -- 172.21.15.96:0/3759526244 >> 172.21.15.96:0/3759526244 conn(0x7f32900c4ae0 msgr2=0x7f32900c2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:46.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.990+0000 7f3295bec640 1 -- 172.21.15.96:0/3759526244 shutdown_connections 2024-04-25T13:40:46.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:46.990+0000 7f3295bec640 1 -- 172.21.15.96:0/3759526244 wait complete. 2024-04-25T13:40:47.007 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new f4e329c3-1d35-4b5f-be15-48d2795092ed 2 2024-04-25T13:40:47.072 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:47.072+0000 7fd71d5d4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:40:47.127 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:47.128+0000 7fd71d5d4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:40:47.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f511da5e640 1 Processor -- start 2024-04-25T13:40:47.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f511da5e640 1 -- start start 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f511da5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5118074690 0x7f5118073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f511da5e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f51181502c0 0x7f51181506d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f511da5e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51180aadb0 con 0x7f511814d350 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f511da5e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5118154530 con 0x7f5118074690 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f511da5e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f51180aa880 con 0x7f51181502c0 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f51177fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f51181502c0 0x7f51181506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f51167fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f511814d350 0x7f511814d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52880/0 (socket says 172.21.15.96:52880) 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f51177fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f51181502c0 0x7f51181506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42972/0 (socket says 172.21.15.96:42972) 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f51167fc640 1 -- 172.21.15.96:0/1500411481 learned_addr learned my addr 172.21.15.96:0/1500411481 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-25T13:40:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f51177fe640 1 -- 172.21.15.96:0/1500411481 >> v2:172.21.15.77:3300/0 conn(0x7f5118074690 msgr2=0x7f5118073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f51177fe640 1 --2- 172.21.15.96:0/1500411481 >> v2:172.21.15.77:3300/0 conn(0x7f5118074690 0x7f5118073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f51177fe640 1 -- 172.21.15.96:0/1500411481 >> v1:172.21.15.96:6789/0 conn(0x7f511814d350 legacy=0x7f511814d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.142+0000 7f51177fe640 1 -- 172.21.15.96:0/1500411481 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51180aaad0 con 0x7f51181502c0 2024-04-25T13:40:47.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f51177fe640 1 --2- 172.21.15.96:0/1500411481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 0x7f51181506d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f511814de70 tx=0x7f511001c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aa7a3031ce15d83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:47.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f5115ffb640 1 -- 172.21.15.96:0/1500411481 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51100b2070 con 0x7f51181502c0 2024-04-25T13:40:47.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f5115ffb640 1 -- 172.21.15.96:0/1500411481 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51100a5850 con 0x7f51181502c0 2024-04-25T13:40:47.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f5115ffb640 1 -- 172.21.15.96:0/1500411481 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51100a5c20 con 0x7f51181502c0 2024-04-25T13:40:47.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 -- 172.21.15.96:0/1500411481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 msgr2=0x7f51181506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 --2- 172.21.15.96:0/1500411481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 0x7f51181506d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f511814de70 tx=0x7f511001c880 comp rx=0 tx=0).stop 2024-04-25T13:40:47.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 -- 172.21.15.96:0/1500411481 shutdown_connections 2024-04-25T13:40:47.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 --2- 172.21.15.96:0/1500411481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 0x7f51181506d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 --2- 172.21.15.96:0/1500411481 >> v2:172.21.15.77:3300/0 conn(0x7f5118074690 0x7f5118073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 -- 172.21.15.96:0/1500411481 >> 172.21.15.96:0/1500411481 conn(0x7f51180a7d80 msgr2=0x7f51180c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:47.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 -- 172.21.15.96:0/1500411481 shutdown_connections 2024-04-25T13:40:47.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 -- 172.21.15.96:0/1500411481 wait complete. 2024-04-25T13:40:47.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 Processor -- start 2024-04-25T13:40:47.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.146+0000 7f511da5e640 1 -- start start 2024-04-25T13:40:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f511da5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5118074690 0x7f5118145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f511da5e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f511814d350 0x7f51181ebd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f511da5e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 0x7f5118158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f511da5e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f511815d7f0 con 0x7f5118074690 2024-04-25T13:40:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f511da5e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f511815d670 con 0x7f51181502c0 2024-04-25T13:40:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f511da5e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f511815d970 con 0x7f511814d350 2024-04-25T13:40:47.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51167fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f511814d350 0x7f51181ebd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51177fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 0x7f5118158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51167fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f511814d350 0x7f51181ebd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:35258/0 (socket says 172.21.15.96:35258) 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51167fc640 1 -- 172.21.15.96:0/412428845 learned_addr learned my addr 172.21.15.96:0/412428845 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51177fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 0x7f5118158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42986/0 (socket says 172.21.15.96:42986) 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f5116ffd640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5118074690 0x7f5118145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51177fe640 1 -- 172.21.15.96:0/412428845 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f511814d350 msgr2=0x7f51181ebd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51177fe640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f511814d350 0x7f51181ebd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51177fe640 1 -- 172.21.15.96:0/412428845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5118074690 msgr2=0x7f5118145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51177fe640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5118074690 0x7f5118145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51177fe640 1 -- 172.21.15.96:0/412428845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51181597f0 con 0x7f51181502c0 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f5116ffd640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5118074690 0x7f5118145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51167fc640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f511814d350 0x7f51181ebd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f51177fe640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 0x7f5118158dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f51180aaa00 tx=0x7f5110019620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:47.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f510ffff640 1 -- 172.21.15.96:0/412428845 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51100b2040 con 0x7f51181502c0 2024-04-25T13:40:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f510ffff640 1 -- 172.21.15.96:0/412428845 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51100bf070 con 0x7f51181502c0 2024-04-25T13:40:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f511da5e640 1 -- 172.21.15.96:0/412428845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51181ec240 con 0x7f51181502c0 2024-04-25T13:40:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f510ffff640 1 -- 172.21.15.96:0/412428845 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51100ada50 con 0x7f51181502c0 2024-04-25T13:40:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f511da5e640 1 -- 172.21.15.96:0/412428845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5118146860 con 0x7f51181502c0 2024-04-25T13:40:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f510ffff640 1 -- 172.21.15.96:0/412428845 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f51100adbf0 con 0x7f51181502c0 2024-04-25T13:40:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f510ffff640 1 -- 172.21.15.96:0/412428845 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f51100b8bf0 con 0x7f51181502c0 2024-04-25T13:40:47.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.150+0000 7f511da5e640 1 -- 172.21.15.96:0/412428845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511806a1a0 con 0x7f51181502c0 2024-04-25T13:40:47.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.154+0000 7f510ffff640 1 -- 172.21.15.96:0/412428845 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5110016500 con 0x7f51181502c0 2024-04-25T13:40:47.180 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:47.180+0000 7fd71d5d4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:40:47.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.222+0000 7f511da5e640 1 -- 172.21.15.96:0/412428845 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4e329c3-1d35-4b5f-be15-48d2795092ed", "id": 2} v 0) -- 0x7f5118145840 con 0x7f51181502c0 2024-04-25T13:40:47.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f510ffff640 1 -- 172.21.15.96:0/412428845 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4e329c3-1d35-4b5f-be15-48d2795092ed", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f51100b8470 con 0x7f51181502c0 2024-04-25T13:40:47.231 INFO:teuthology.orchestra.run.smithi096.stdout:2 2024-04-25T13:40:47.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f511da5e640 1 -- 172.21.15.96:0/412428845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 msgr2=0x7f5118158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f511da5e640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 0x7f5118158dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f51180aaa00 tx=0x7f5110019620 comp rx=0 tx=0).stop 2024-04-25T13:40:47.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f511da5e640 1 -- 172.21.15.96:0/412428845 shutdown_connections 2024-04-25T13:40:47.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f511da5e640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51181502c0 0x7f5118158dd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f511da5e640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f511814d350 0x7f51181ebd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f511da5e640 1 --2- 172.21.15.96:0/412428845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5118074690 0x7f5118145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f511da5e640 1 -- 172.21.15.96:0/412428845 >> 172.21.15.96:0/412428845 conn(0x7f51180a7d80 msgr2=0x7f51180c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:47.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f511da5e640 1 -- 172.21.15.96:0/412428845 shutdown_connections 2024-04-25T13:40:47.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.230+0000 7f511da5e640 1 -- 172.21.15.96:0/412428845 wait complete. 2024-04-25T13:40:47.250 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 50871651-83fd-4cce-b440-7e8407f3deb1 3 2024-04-25T13:40:47.251 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:47.246+0000 7fc485ee8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:40:47.258 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:47.256+0000 7fd71d5d4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:40:47.306 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:47.306+0000 7fc485ee8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:40:47.310 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:47.308+0000 7fd71d5d4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:40:47.361 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:47.358+0000 7fc485ee8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:40:47.387 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:47.388+0000 7fd71d5d4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:40:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.386+0000 7fdc12ebb640 1 Processor -- start 2024-04-25T13:40:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc12ebb640 1 -- start start 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc12ebb640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc0c0a8bd0 0x7fdc0c073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc12ebb640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c14e710 0x7fdc0c14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc12ebb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc0c14f2a0 con 0x7fdc0c06fa90 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc12ebb640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0c14f060 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc12ebb640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0c1535a0 con 0x7fdc0c14e710 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc11458640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c14e710 0x7fdc0c14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc0bfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdc0c06fa90 0x7fdc0c14faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52884/0 (socket says 172.21.15.96:52884) 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc11458640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c14e710 0x7fdc0c14eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:35260/0 (socket says 172.21.15.96:35260) 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc0bfff640 1 -- 172.21.15.96:0/1144138866 learned_addr learned my addr 172.21.15.96:0/1144138866 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc10c57640 1 --2- 172.21.15.96:0/1144138866 >> v2:172.21.15.77:3300/0 conn(0x7fdc0c0a8bd0 0x7fdc0c073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc11458640 1 -- 172.21.15.96:0/1144138866 >> v2:172.21.15.77:3300/0 conn(0x7fdc0c0a8bd0 msgr2=0x7fdc0c073bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc11458640 1 --2- 172.21.15.96:0/1144138866 >> v2:172.21.15.77:3300/0 conn(0x7fdc0c0a8bd0 0x7fdc0c073bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc11458640 1 -- 172.21.15.96:0/1144138866 >> v1:172.21.15.96:6789/0 conn(0x7fdc0c06fa90 legacy=0x7fdc0c14faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc0b7fe640 1 -- 172.21.15.96:0/1144138866 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386035556 0 0) 0x7fdc0c14f2a0 con 0x7fdc0c06fa90 2024-04-25T13:40:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.390+0000 7fdc11458640 1 -- 172.21.15.96:0/1144138866 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c14f580 con 0x7fdc0c14e710 2024-04-25T13:40:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc11458640 1 --2- 172.21.15.96:0/1144138866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c14e710 0x7fdc0c14eb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009d90 tx=0x7fdc0401eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626e5234e7f64de2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc0b7fe640 1 -- 172.21.15.96:0/1144138866 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc040b4070 con 0x7fdc0c14e710 2024-04-25T13:40:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc0b7fe640 1 -- 172.21.15.96:0/1144138866 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc040a7b10 con 0x7fdc0c14e710 2024-04-25T13:40:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc0b7fe640 1 -- 172.21.15.96:0/1144138866 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc040af440 con 0x7fdc0c14e710 2024-04-25T13:40:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1144138866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c14e710 msgr2=0x7fdc0c14eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 --2- 172.21.15.96:0/1144138866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c14e710 0x7fdc0c14eb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009d90 tx=0x7fdc0401eb20 comp rx=0 tx=0).stop 2024-04-25T13:40:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1144138866 shutdown_connections 2024-04-25T13:40:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 --2- 172.21.15.96:0/1144138866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c14e710 0x7fdc0c14eb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 --2- 172.21.15.96:0/1144138866 >> v2:172.21.15.77:3300/0 conn(0x7fdc0c0a8bd0 0x7fdc0c073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1144138866 >> 172.21.15.96:0/1144138866 conn(0x7fdc0c0c4ae0 msgr2=0x7fdc0c0c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1144138866 shutdown_connections 2024-04-25T13:40:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1144138866 wait complete. 2024-04-25T13:40:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 Processor -- start 2024-04-25T13:40:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.394+0000 7fdc12ebb640 1 -- start start 2024-04-25T13:40:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc12ebb640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c06fa90 0x7fdc0c14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc12ebb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0a8bd0 0x7fdc0c1496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc12ebb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c14e710 0x7fdc0c149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc12ebb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c070020 con 0x7fdc0c14e710 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc12ebb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c06fea0 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc12ebb640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0c06cdc0 con 0x7fdc0c06fa90 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc10c57640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c06fa90 0x7fdc0c14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc10c57640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c06fa90 0x7fdc0c14ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:35266/0 (socket says 172.21.15.96:35266) 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc10c57640 1 -- 172.21.15.96:0/1694745984 learned_addr learned my addr 172.21.15.96:0/1694745984 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc0bfff640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0a8bd0 0x7fdc0c1496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc11458640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c14e710 0x7fdc0c149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc0bfff640 1 -- 172.21.15.96:0/1694745984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c06fa90 msgr2=0x7fdc0c14ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc0bfff640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c06fa90 0x7fdc0c14ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc0bfff640 1 -- 172.21.15.96:0/1694745984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c14e710 msgr2=0x7fdc0c149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc0bfff640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c14e710 0x7fdc0c149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc0bfff640 1 -- 172.21.15.96:0/1694745984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c0a4f90 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc10c57640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c06fa90 0x7fdc0c14ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc11458640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c14e710 0x7fdc0c149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc0bfff640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0a8bd0 0x7fdc0c1496c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c410 tx=0x7fdbf800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc097fa640 1 -- 172.21.15.96:0/1694745984 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80074e0 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc097fa640 1 -- 172.21.15.96:0/1694745984 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf80047f0 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc097fa640 1 -- 172.21.15.96:0/1694745984 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8007680 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1694745984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c14a140 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1694745984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c0a5dd0 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc097fa640 1 -- 172.21.15.96:0/1694745984 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdbf8011070 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc097fa640 1 -- 172.21.15.96:0/1694745984 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fdbf8013850 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.398+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1694745984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0c06a1a0 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.402+0000 7fdc097fa640 1 -- 172.21.15.96:0/1694745984 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fdbf8004d90 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.440 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:47.440+0000 7fd71d5d4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:40:47.442 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:47.442+0000 7fc485ee8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:40:47.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.466+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1694745984 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "50871651-83fd-4cce-b440-7e8407f3deb1", "id": 3} v 0) -- 0x7fdc0c157c70 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.474+0000 7fdc097fa640 1 -- 172.21.15.96:0/1694745984 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50871651-83fd-4cce-b440-7e8407f3deb1", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fdbf8013480 con 0x7fdc0c0a8bd0 2024-04-25T13:40:47.477 INFO:teuthology.orchestra.run.smithi096.stdout:3 2024-04-25T13:40:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.478+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1694745984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0a8bd0 msgr2=0x7fdc0c1496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.478+0000 7fdc12ebb640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0a8bd0 0x7fdc0c1496c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c410 tx=0x7fdbf800c8d0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.478+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1694745984 shutdown_connections 2024-04-25T13:40:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.478+0000 7fdc12ebb640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c14e710 0x7fdc0c149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.478+0000 7fdc12ebb640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc0c0a8bd0 0x7fdc0c1496c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.478+0000 7fdc12ebb640 1 --2- 172.21.15.96:0/1694745984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc0c06fa90 0x7fdc0c14ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.478+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1694745984 >> 172.21.15.96:0/1694745984 conn(0x7fdc0c0c4ae0 msgr2=0x7fdc0c0c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.478+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1694745984 shutdown_connections 2024-04-25T13:40:47.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.478+0000 7fdc12ebb640 1 -- 172.21.15.96:0/1694745984 wait complete. 2024-04-25T13:40:47.495 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new a87d1437-b6ee-4215-ae40-4710282e5947 4 2024-04-25T13:40:47.497 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:47.494+0000 7fc485ee8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:40:47.578 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:47.578+0000 7fc485ee8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:40:47.590 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:47.592+0000 7fd71d5d4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:40:47.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.626+0000 7fc44c0e6640 1 Processor -- start 2024-04-25T13:40:47.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.626+0000 7fc44c0e6640 1 -- start start 2024-04-25T13:40:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc44c0e6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc444154470 0x7fc444151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc44c0e6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc4440c1c80 0x7fc4440c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc44c0e6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc44414f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc44c0e6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc4441506b0 con 0x7fc444154470 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc44c0e6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc444150990 con 0x7fc4440c1c80 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc44c0e6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc444150c70 con 0x7fc4440c2c00 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449681640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc4440c1c80 0x7fc4440c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc44a683640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc44414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449681640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc4440c1c80 0x7fc4440c26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43008/0 (socket says 172.21.15.96:43008) 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc44a683640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc44414f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:35268/0 (socket says 172.21.15.96:35268) 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449681640 1 -- 172.21.15.96:0/3506106616 learned_addr learned my addr 172.21.15.96:0/3506106616 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449e82640 1 --2- 172.21.15.96:0/3506106616 >> v2:172.21.15.77:3300/0 conn(0x7fc444154470 0x7fc444151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449681640 1 -- 172.21.15.96:0/3506106616 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 msgr2=0x7fc44414f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449681640 1 --2- 172.21.15.96:0/3506106616 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc44414f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449681640 1 -- 172.21.15.96:0/3506106616 >> v2:172.21.15.77:3300/0 conn(0x7fc444154470 msgr2=0x7fc444151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:47.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449681640 1 --2- 172.21.15.96:0/3506106616 >> v2:172.21.15.77:3300/0 conn(0x7fc444154470 0x7fc444151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449681640 1 -- 172.21.15.96:0/3506106616 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4440c3010 con 0x7fc4440c1c80 2024-04-25T13:40:47.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc44a683640 1 --2- 172.21.15.96:0/3506106616 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc44414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:40:47.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449e82640 1 --2- 172.21.15.96:0/3506106616 >> v2:172.21.15.77:3300/0 conn(0x7fc444154470 0x7fc444151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:40:47.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc449681640 1 --2- 172.21.15.96:0/3506106616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4440c1c80 0x7fc4440c26c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc4440721e0 tx=0x7fc43401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab089546d4e13827 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:47.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc448e80640 1 -- 172.21.15.96:0/3506106616 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340b0070 con 0x7fc4440c1c80 2024-04-25T13:40:47.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc448e80640 1 -- 172.21.15.96:0/3506106616 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4340ab600 con 0x7fc4440c1c80 2024-04-25T13:40:47.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.630+0000 7fc448e80640 1 -- 172.21.15.96:0/3506106616 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340ab9d0 con 0x7fc4440c1c80 2024-04-25T13:40:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 -- 172.21.15.96:0/3506106616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4440c1c80 msgr2=0x7fc4440c26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 --2- 172.21.15.96:0/3506106616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4440c1c80 0x7fc4440c26c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc4440721e0 tx=0x7fc43401c460 comp rx=0 tx=0).stop 2024-04-25T13:40:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 -- 172.21.15.96:0/3506106616 shutdown_connections 2024-04-25T13:40:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 --2- 172.21.15.96:0/3506106616 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc44414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 --2- 172.21.15.96:0/3506106616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4440c1c80 0x7fc4440c26c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 --2- 172.21.15.96:0/3506106616 >> v2:172.21.15.77:3300/0 conn(0x7fc444154470 0x7fc444151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 -- 172.21.15.96:0/3506106616 >> 172.21.15.96:0/3506106616 conn(0x7fc4440a6970 msgr2=0x7fc4440a6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 -- 172.21.15.96:0/3506106616 shutdown_connections 2024-04-25T13:40:47.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 -- 172.21.15.96:0/3506106616 wait complete. 2024-04-25T13:40:47.635 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc485ee8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:40:47.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 Processor -- start 2024-04-25T13:40:47.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 -- start start 2024-04-25T13:40:47.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4440c1c80 0x7fc44414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc4441ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc444154470 0x7fc44413dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc44406d190 con 0x7fc4440c1c80 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc44406d010 con 0x7fc444154470 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44c0e6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc44406d310 con 0x7fc4440c2c00 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44a683640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc444154470 0x7fc44413dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44a683640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc444154470 0x7fc44413dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43010/0 (socket says 172.21.15.96:43010) 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc44a683640 1 -- 172.21.15.96:0/39534345 learned_addr learned my addr 172.21.15.96:0/39534345 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.634+0000 7fc449681640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc4441ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc449e82640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4440c1c80 0x7fc44414e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc44a683640 1 -- 172.21.15.96:0/39534345 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 msgr2=0x7fc4441ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc44a683640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc4441ecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc44a683640 1 -- 172.21.15.96:0/39534345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4440c1c80 msgr2=0x7fc44414e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc44a683640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4440c1c80 0x7fc44414e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc44a683640 1 -- 172.21.15.96:0/39534345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4441436e0 con 0x7fc444154470 2024-04-25T13:40:47.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc449681640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc4441ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc449e82640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4440c1c80 0x7fc44414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc44a683640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc444154470 0x7fc44413dac0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00eec0 tx=0x7fc43c00b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc43a7fc640 1 -- 172.21.15.96:0/39534345 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c018020 con 0x7fc444154470 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc43a7fc640 1 -- 172.21.15.96:0/39534345 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43c014400 con 0x7fc444154470 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc44c0e6640 1 -- 172.21.15.96:0/39534345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44414f780 con 0x7fc444154470 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc43a7fc640 1 -- 172.21.15.96:0/39534345 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0147d0 con 0x7fc444154470 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc44c0e6640 1 -- 172.21.15.96:0/39534345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4441eda70 con 0x7fc444154470 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc43a7fc640 1 -- 172.21.15.96:0/39534345 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc43c01b020 con 0x7fc444154470 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc43a7fc640 1 -- 172.21.15.96:0/39534345 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc43c01dd20 con 0x7fc444154470 2024-04-25T13:40:47.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc44c0e6640 1 -- 172.21.15.96:0/39534345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44406a1a0 con 0x7fc444154470 2024-04-25T13:40:47.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.638+0000 7fc43a7fc640 1 -- 172.21.15.96:0/39534345 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc43c022030 con 0x7fc444154470 2024-04-25T13:40:47.653 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:47.652+0000 7fd71d5d4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:40:47.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.702+0000 7fc44c0e6640 1 -- 172.21.15.96:0/39534345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a87d1437-b6ee-4215-ae40-4710282e5947", "id": 4} v 0) -- 0x7fc44413f540 con 0x7fc444154470 2024-04-25T13:40:47.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc43a7fc640 1 -- 172.21.15.96:0/39534345 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a87d1437-b6ee-4215-ae40-4710282e5947", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fc43c01d400 con 0x7fc444154470 2024-04-25T13:40:47.713 INFO:teuthology.orchestra.run.smithi096.stdout:4 2024-04-25T13:40:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc44c0e6640 1 -- 172.21.15.96:0/39534345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc444154470 msgr2=0x7fc44413dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc44c0e6640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc444154470 0x7fc44413dac0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00eec0 tx=0x7fc43c00b480 comp rx=0 tx=0).stop 2024-04-25T13:40:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc44c0e6640 1 -- 172.21.15.96:0/39534345 shutdown_connections 2024-04-25T13:40:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc44c0e6640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc444154470 0x7fc44413dac0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc44c0e6640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4440c2c00 0x7fc4441ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc44c0e6640 1 --2- 172.21.15.96:0/39534345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4440c1c80 0x7fc44414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc44c0e6640 1 -- 172.21.15.96:0/39534345 >> 172.21.15.96:0/39534345 conn(0x7fc4440a6970 msgr2=0x7fc4440756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc44c0e6640 1 -- 172.21.15.96:0/39534345 shutdown_connections 2024-04-25T13:40:47.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.710+0000 7fc44c0e6640 1 -- 172.21.15.96:0/39534345 wait complete. 2024-04-25T13:40:47.731 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new e65b4988-038d-468b-92a3-243a327be1fe 5 2024-04-25T13:40:47.791 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:47.790+0000 7fc485ee8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:40:47.854 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:47.854+0000 7fc485ee8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:40:47.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.862+0000 7fcdd15a2640 1 Processor -- start 2024-04-25T13:40:47.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.862+0000 7fcdd15a2640 1 -- start start 2024-04-25T13:40:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdd15a2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcdcc0a8bd0 0x7fcdcc073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdd15a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcdcc06fa90 0x7fcdcc14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdd15a2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc14e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdd15a2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcdcc1535a0 con 0x7fcdcc06fa90 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdd15a2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fcdcc14f2a0 con 0x7fcdcc0a8bd0 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdd15a2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc14f580 con 0x7fcdcc14ffe0 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcb7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc14e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcaffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcdcc0a8bd0 0x7fcdcc073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcb7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc14e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:35288/0 (socket says 172.21.15.96:35288) 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcb7fe640 1 -- 172.21.15.96:0/951489125 learned_addr learned my addr 172.21.15.96:0/951489125 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdca7fc640 1 --2- 172.21.15.96:0/951489125 >> v2:172.21.15.77:3300/0 conn(0x7fcdcc06fa90 0x7fcdcc14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcaffd640 1 -- 172.21.15.96:0/951489125 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 msgr2=0x7fcdcc14e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcaffd640 1 --2- 172.21.15.96:0/951489125 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc14e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcaffd640 1 -- 172.21.15.96:0/951489125 >> v2:172.21.15.77:3300/0 conn(0x7fcdcc06fa90 msgr2=0x7fcdcc14faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcaffd640 1 --2- 172.21.15.96:0/951489125 >> v2:172.21.15.77:3300/0 conn(0x7fcdcc06fa90 0x7fcdcc14faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcaffd640 1 -- 172.21.15.96:0/951489125 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc074130 con 0x7fcdcc0a8bd0 2024-04-25T13:40:47.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcb7fe640 1 --2- 172.21.15.96:0/951489125 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:40:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdcaffd640 1 --2- 172.21.15.96:0/951489125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0a8bd0 0x7fcdcc073bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc072d70 tx=0x7fcdbc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7dcc4787e5d2db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdc9ffb640 1 -- 172.21.15.96:0/951489125 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0b0070 con 0x7fcdcc0a8bd0 2024-04-25T13:40:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdc9ffb640 1 -- 172.21.15.96:0/951489125 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc004230 con 0x7fcdcc0a8bd0 2024-04-25T13:40:47.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.866+0000 7fcdc9ffb640 1 -- 172.21.15.96:0/951489125 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc003620 con 0x7fcdcc0a8bd0 2024-04-25T13:40:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 -- 172.21.15.96:0/951489125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0a8bd0 msgr2=0x7fcdcc073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 --2- 172.21.15.96:0/951489125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0a8bd0 0x7fcdcc073bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc072d70 tx=0x7fcdbc01c480 comp rx=0 tx=0).stop 2024-04-25T13:40:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 -- 172.21.15.96:0/951489125 shutdown_connections 2024-04-25T13:40:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 --2- 172.21.15.96:0/951489125 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 --2- 172.21.15.96:0/951489125 >> v2:172.21.15.77:3300/0 conn(0x7fcdcc06fa90 0x7fcdcc14faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 --2- 172.21.15.96:0/951489125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0a8bd0 0x7fcdcc073bf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 -- 172.21.15.96:0/951489125 >> 172.21.15.96:0/951489125 conn(0x7fcdcc0c4ae0 msgr2=0x7fcdcc0c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 -- 172.21.15.96:0/951489125 shutdown_connections 2024-04-25T13:40:47.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 -- 172.21.15.96:0/951489125 wait complete. 2024-04-25T13:40:47.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 Processor -- start 2024-04-25T13:40:47.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 -- start start 2024-04-25T13:40:47.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc06fa90 0x7fcdcc14ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0a8bd0 0x7fcdcc147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc1483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:47.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0a8430 con 0x7fcdcc0a8bd0 2024-04-25T13:40:47.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0a82b0 con 0x7fcdcc06fa90 2024-04-25T13:40:47.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdd15a2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc0a85b0 con 0x7fcdcc14ffe0 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdcaffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc06fa90 0x7fcdcc14ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdcb7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc1483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdcaffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc06fa90 0x7fcdcc14ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43030/0 (socket says 172.21.15.96:43030) 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdcaffd640 1 -- 172.21.15.96:0/2753548073 learned_addr learned my addr 172.21.15.96:0/2753548073 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdca7fc640 1 --2- 172.21.15.96:0/2753548073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0a8bd0 0x7fcdcc147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdcaffd640 1 -- 172.21.15.96:0/2753548073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 msgr2=0x7fcdcc1483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdcaffd640 1 --2- 172.21.15.96:0/2753548073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc1483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdcaffd640 1 -- 172.21.15.96:0/2753548073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0a8bd0 msgr2=0x7fcdcc147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdcaffd640 1 --2- 172.21.15.96:0/2753548073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0a8bd0 0x7fcdcc147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.870+0000 7fcdcaffd640 1 -- 172.21.15.96:0/2753548073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc157b60 con 0x7fcdcc06fa90 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdcaffd640 1 --2- 172.21.15.96:0/2753548073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc06fa90 0x7fcdcc14ddc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0ae040 tx=0x7fcdbc019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdb37fe640 1 -- 172.21.15.96:0/2753548073 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0b0040 con 0x7fcdcc06fa90 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdb37fe640 1 -- 172.21.15.96:0/2753548073 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc0bc070 con 0x7fcdcc06fa90 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdd15a2640 1 -- 172.21.15.96:0/2753548073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc1ec5f0 con 0x7fcdcc06fa90 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdb37fe640 1 -- 172.21.15.96:0/2753548073 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0043e0 con 0x7fcdcc06fa90 2024-04-25T13:40:47.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdd15a2640 1 -- 172.21.15.96:0/2753548073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc1ec8d0 con 0x7fcdcc06fa90 2024-04-25T13:40:47.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdb37fe640 1 -- 172.21.15.96:0/2753548073 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcdbc0b3070 con 0x7fcdcc06fa90 2024-04-25T13:40:47.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdb37fe640 1 -- 172.21.15.96:0/2753548073 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fcdbc0b5c50 con 0x7fcdcc06fa90 2024-04-25T13:40:47.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdd15a2640 1 -- 172.21.15.96:0/2753548073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdcc06a1a0 con 0x7fcdcc06fa90 2024-04-25T13:40:47.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.874+0000 7fcdb37fe640 1 -- 172.21.15.96:0/2753548073 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fcdbc016070 con 0x7fcdcc06fa90 2024-04-25T13:40:47.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.938+0000 7fcdd15a2640 1 -- 172.21.15.96:0/2753548073 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e65b4988-038d-468b-92a3-243a327be1fe", "id": 5} v 0) -- 0x7fcdcc157d30 con 0x7fcdcc06fa90 2024-04-25T13:40:47.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.946+0000 7fcdb37fe640 1 -- 172.21.15.96:0/2753548073 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e65b4988-038d-468b-92a3-243a327be1fe", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fcdbc0b5480 con 0x7fcdcc06fa90 2024-04-25T13:40:47.949 INFO:teuthology.orchestra.run.smithi096.stdout:5 2024-04-25T13:40:47.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.946+0000 7fcdd15a2640 1 -- 172.21.15.96:0/2753548073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc06fa90 msgr2=0x7fcdcc14ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.946+0000 7fcdd15a2640 1 --2- 172.21.15.96:0/2753548073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc06fa90 0x7fcdcc14ddc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0ae040 tx=0x7fcdbc019220 comp rx=0 tx=0).stop 2024-04-25T13:40:47.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.946+0000 7fcdd15a2640 1 -- 172.21.15.96:0/2753548073 shutdown_connections 2024-04-25T13:40:47.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.946+0000 7fcdd15a2640 1 --2- 172.21.15.96:0/2753548073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcdcc14ffe0 0x7fcdcc1483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.946+0000 7fcdd15a2640 1 --2- 172.21.15.96:0/2753548073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0a8bd0 0x7fcdcc147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.946+0000 7fcdd15a2640 1 --2- 172.21.15.96:0/2753548073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc06fa90 0x7fcdcc14ddc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.946+0000 7fcdd15a2640 1 -- 172.21.15.96:0/2753548073 >> 172.21.15.96:0/2753548073 conn(0x7fcdcc0c4ae0 msgr2=0x7fcdcc072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:47.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.950+0000 7fcdd15a2640 1 -- 172.21.15.96:0/2753548073 shutdown_connections 2024-04-25T13:40:47.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:47.950+0000 7fcdd15a2640 1 -- 172.21.15.96:0/2753548073 wait complete. 2024-04-25T13:40:47.967 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new d709e3a4-7c69-4eeb-ae98-86539706c15c 6 2024-04-25T13:40:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.106+0000 7f6a6e019640 1 Processor -- start 2024-04-25T13:40:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.106+0000 7f6a6e019640 1 -- start start 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a680a8bd0 0x7f6a68073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6a6806fa90 0x7f6a6814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6814f2a0 con 0x7f6a6814ffe0 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6a681535a0 con 0x7f6a680a8bd0 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6814f580 con 0x7f6a6806fa90 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a66ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6a6806fa90 0x7f6a6814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a66ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6a6806fa90 0x7f6a6814faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43038/0 (socket says 172.21.15.96:43038) 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a66ffd640 1 -- 172.21.15.96:0/1741760134 learned_addr learned my addr 172.21.15.96:0/1741760134 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a677fe640 1 --2- 172.21.15.96:0/1741760134 >> v2:172.21.15.77:3300/0 conn(0x7f6a680a8bd0 0x7f6a68073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a66ffd640 1 -- 172.21.15.96:0/1741760134 >> v2:172.21.15.77:3300/0 conn(0x7f6a680a8bd0 msgr2=0x7f6a68073bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:48.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a66ffd640 1 --2- 172.21.15.96:0/1741760134 >> v2:172.21.15.77:3300/0 conn(0x7f6a680a8bd0 0x7f6a68073bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a66ffd640 1 -- 172.21.15.96:0/1741760134 >> v1:172.21.15.77:6789/0 conn(0x7f6a6814ffe0 legacy=0x7f6a6814e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:48.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a66ffd640 1 -- 172.21.15.96:0/1741760134 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a68074130 con 0x7f6a6806fa90 2024-04-25T13:40:48.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a66ffd640 1 --2- 172.21.15.96:0/1741760134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 0x7f6a6814faa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6a68072110 tx=0x7f6a5401c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb83f4403a2469ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:48.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a667fc640 1 -- 172.21.15.96:0/1741760134 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a540aa660 con 0x7f6a6806fa90 2024-04-25T13:40:48.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a667fc640 1 -- 172.21.15.96:0/1741760134 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a540af070 con 0x7f6a6806fa90 2024-04-25T13:40:48.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a667fc640 1 -- 172.21.15.96:0/1741760134 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a540aaa20 con 0x7f6a6806fa90 2024-04-25T13:40:48.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 -- 172.21.15.96:0/1741760134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 msgr2=0x7f6a6814faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 --2- 172.21.15.96:0/1741760134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 0x7f6a6814faa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6a68072110 tx=0x7f6a5401c4e0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 -- 172.21.15.96:0/1741760134 shutdown_connections 2024-04-25T13:40:48.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 --2- 172.21.15.96:0/1741760134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 0x7f6a6814faa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 --2- 172.21.15.96:0/1741760134 >> v2:172.21.15.77:3300/0 conn(0x7f6a680a8bd0 0x7f6a68073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 -- 172.21.15.96:0/1741760134 >> 172.21.15.96:0/1741760134 conn(0x7f6a680c4ae0 msgr2=0x7f6a680c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:48.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 -- 172.21.15.96:0/1741760134 shutdown_connections 2024-04-25T13:40:48.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.110+0000 7f6a6e019640 1 -- 172.21.15.96:0/1741760134 wait complete. 2024-04-25T13:40:48.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 Processor -- start 2024-04-25T13:40:48.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 -- start start 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 0x7f6a681509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a680a8bd0 0x7f6a68147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a6814ffe0 0x7f6a681582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6815c220 con 0x7f6a680a8bd0 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6814f030 con 0x7f6a6806fa90 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6815c3a0 con 0x7f6a6814ffe0 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a677fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 0x7f6a681509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a677fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 0x7f6a681509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43040/0 (socket says 172.21.15.96:43040) 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a677fe640 1 -- 172.21.15.96:0/4183935943 learned_addr learned my addr 172.21.15.96:0/4183935943 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a67fff640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a6814ffe0 0x7f6a681582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a66ffd640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a680a8bd0 0x7f6a68147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a677fe640 1 -- 172.21.15.96:0/4183935943 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a6814ffe0 msgr2=0x7f6a681582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a677fe640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a6814ffe0 0x7f6a681582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a677fe640 1 -- 172.21.15.96:0/4183935943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a680a8bd0 msgr2=0x7f6a68147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a677fe640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a680a8bd0 0x7f6a68147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a677fe640 1 -- 172.21.15.96:0/4183935943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a68159010 con 0x7f6a6806fa90 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a66ffd640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a680a8bd0 0x7f6a68147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a677fe640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 0x7f6a681509f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a58007e40 tx=0x7f6a5800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a5ffff640 1 -- 172.21.15.96:0/4183935943 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58014620 con 0x7f6a6806fa90 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a5ffff640 1 -- 172.21.15.96:0/4183935943 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a58019070 con 0x7f6a6806fa90 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 -- 172.21.15.96:0/4183935943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a681ef5b0 con 0x7f6a6806fa90 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a5ffff640 1 -- 172.21.15.96:0/4183935943 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58014a00 con 0x7f6a6806fa90 2024-04-25T13:40:48.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a6e019640 1 -- 172.21.15.96:0/4183935943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a68147970 con 0x7f6a6806fa90 2024-04-25T13:40:48.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a5ffff640 1 -- 172.21.15.96:0/4183935943 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6a58014ba0 con 0x7f6a6806fa90 2024-04-25T13:40:48.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.114+0000 7f6a5ffff640 1 -- 172.21.15.96:0/4183935943 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f6a5801d9b0 con 0x7f6a6806fa90 2024-04-25T13:40:48.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.118+0000 7f6a5dffb640 1 -- 172.21.15.96:0/4183935943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a480052a0 con 0x7f6a6806fa90 2024-04-25T13:40:48.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.118+0000 7f6a5ffff640 1 -- 172.21.15.96:0/4183935943 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6a5801dbb0 con 0x7f6a6806fa90 2024-04-25T13:40:48.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.194+0000 7f6a5dffb640 1 -- 172.21.15.96:0/4183935943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d709e3a4-7c69-4eeb-ae98-86539706c15c", "id": 6} v 0) -- 0x7f6a48005860 con 0x7f6a6806fa90 2024-04-25T13:40:48.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5ffff640 1 -- 172.21.15.96:0/4183935943 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d709e3a4-7c69-4eeb-ae98-86539706c15c", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f6a5801dd90 con 0x7f6a6806fa90 2024-04-25T13:40:48.208 INFO:teuthology.orchestra.run.smithi096.stdout:6 2024-04-25T13:40:48.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5dffb640 1 -- 172.21.15.96:0/4183935943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 msgr2=0x7f6a681509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5dffb640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 0x7f6a681509f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a58007e40 tx=0x7f6a5800e4b0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5dffb640 1 -- 172.21.15.96:0/4183935943 shutdown_connections 2024-04-25T13:40:48.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5dffb640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a6814ffe0 0x7f6a681582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5dffb640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a680a8bd0 0x7f6a68147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5dffb640 1 --2- 172.21.15.96:0/4183935943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a6806fa90 0x7f6a681509f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5dffb640 1 -- 172.21.15.96:0/4183935943 >> 172.21.15.96:0/4183935943 conn(0x7f6a680c4ae0 msgr2=0x7f6a68070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:48.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5dffb640 1 -- 172.21.15.96:0/4183935943 shutdown_connections 2024-04-25T13:40:48.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.206+0000 7f6a5dffb640 1 -- 172.21.15.96:0/4183935943 wait complete. 2024-04-25T13:40:48.231 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 959e7f84-6fc5-496f-bcc2-2085b6070a7f 7 2024-04-25T13:40:48.317 INFO:tasks.ceph.mgr.y.smithi077.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T13:40:48.317 INFO:tasks.ceph.mgr.y.smithi077.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T13:40:48.317 INFO:tasks.ceph.mgr.y.smithi077.stderr: from numpy import show_config as show_numpy_config 2024-04-25T13:40:48.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.378+0000 7f7234dfe640 1 Processor -- start 2024-04-25T13:40:48.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.378+0000 7f7234dfe640 1 -- start start 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.378+0000 7f7234dfe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f72300a8f80 0x7f723006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7230073790 0x7f7230073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7230072c80 con 0x7f7230074570 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f72300732d0 con 0x7f7230073790 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f723006ce30 con 0x7f72300a8f80 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722dd9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7230074570 0x7f7230152cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52900/0 (socket says 172.21.15.96:52900) 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722e59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f72300a8f80 0x7f723006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722dd9b640 1 -- 172.21.15.96:0/3316370662 learned_addr learned my addr 172.21.15.96:0/3316370662 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722e59c640 1 -- 172.21.15.96:0/3316370662 >> v2:172.21.15.77:3300/0 conn(0x7f7230073790 msgr2=0x7f7230073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722e59c640 1 --2- 172.21.15.96:0/3316370662 >> v2:172.21.15.77:3300/0 conn(0x7f7230073790 0x7f7230073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722e59c640 1 -- 172.21.15.96:0/3316370662 >> v1:172.21.15.96:6789/0 conn(0x7f7230074570 legacy=0x7f7230152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722e59c640 1 -- 172.21.15.96:0/3316370662 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7230072f60 con 0x7f72300a8f80 2024-04-25T13:40:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722e59c640 1 --2- 172.21.15.96:0/3316370662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72300a8f80 0x7f723006c8f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7230074d70 tx=0x7f721801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f37992e9975c6ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722d59a640 1 -- 172.21.15.96:0/3316370662 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180b1070 con 0x7f72300a8f80 2024-04-25T13:40:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722d59a640 1 -- 172.21.15.96:0/3316370662 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72180ac5f0 con 0x7f72300a8f80 2024-04-25T13:40:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f722d59a640 1 -- 172.21.15.96:0/3316370662 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180ac9c0 con 0x7f72300a8f80 2024-04-25T13:40:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 -- 172.21.15.96:0/3316370662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72300a8f80 msgr2=0x7f723006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 --2- 172.21.15.96:0/3316370662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72300a8f80 0x7f723006c8f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7230074d70 tx=0x7f721801c480 comp rx=0 tx=0).stop 2024-04-25T13:40:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 -- 172.21.15.96:0/3316370662 shutdown_connections 2024-04-25T13:40:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 --2- 172.21.15.96:0/3316370662 >> v2:172.21.15.77:3300/0 conn(0x7f7230073790 0x7f7230073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 --2- 172.21.15.96:0/3316370662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72300a8f80 0x7f723006c8f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 -- 172.21.15.96:0/3316370662 >> 172.21.15.96:0/3316370662 conn(0x7f72300c4ae0 msgr2=0x7f72300c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 -- 172.21.15.96:0/3316370662 shutdown_connections 2024-04-25T13:40:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.382+0000 7f7234dfe640 1 -- 172.21.15.96:0/3316370662 wait complete. 2024-04-25T13:40:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 Processor -- start 2024-04-25T13:40:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 -- start start 2024-04-25T13:40:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7230073790 0x7f72301eb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7230074570 0x7f7230142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72300a8f80 0x7f7230143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72301535e0 con 0x7f72300a8f80 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f72300742f0 con 0x7f7230073790 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f723015f500 con 0x7f7230074570 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7230073790 0x7f72301eb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7230073790 0x7f72301eb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43068/0 (socket says 172.21.15.96:43068) 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722e59c640 1 -- 172.21.15.96:0/1797440042 learned_addr learned my addr 172.21.15.96:0/1797440042 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722dd9b640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7230074570 0x7f7230142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722ed9d640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72300a8f80 0x7f7230143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722e59c640 1 -- 172.21.15.96:0/1797440042 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7230074570 msgr2=0x7f7230142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722e59c640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7230074570 0x7f7230142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722e59c640 1 -- 172.21.15.96:0/1797440042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72300a8f80 msgr2=0x7f7230143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722e59c640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72300a8f80 0x7f7230143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722e59c640 1 -- 172.21.15.96:0/1797440042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7230151660 con 0x7f7230073790 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722dd9b640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7230074570 0x7f7230142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722ed9d640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72300a8f80 0x7f7230143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:40:48.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f722e59c640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7230073790 0x7f72301eb9a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f721801c960 tx=0x7f7218019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7226ffd640 1 -- 172.21.15.96:0/1797440042 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180b1040 con 0x7f7230073790 2024-04-25T13:40:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7226ffd640 1 -- 172.21.15.96:0/1797440042 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72180bb070 con 0x7f7230073790 2024-04-25T13:40:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7226ffd640 1 -- 172.21.15.96:0/1797440042 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180b5650 con 0x7f7230073790 2024-04-25T13:40:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 -- 172.21.15.96:0/1797440042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7230143070 con 0x7f7230073790 2024-04-25T13:40:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7234dfe640 1 -- 172.21.15.96:0/1797440042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7230140380 con 0x7f7230073790 2024-04-25T13:40:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7226ffd640 1 -- 172.21.15.96:0/1797440042 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72180b57f0 con 0x7f7230073790 2024-04-25T13:40:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.386+0000 7f7226ffd640 1 -- 172.21.15.96:0/1797440042 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f72180bf3c0 con 0x7f7230073790 2024-04-25T13:40:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.390+0000 7f7234dfe640 1 -- 172.21.15.96:0/1797440042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f723006a1a0 con 0x7f7230073790 2024-04-25T13:40:48.393 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:48.392+0000 7fd71d5d4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:40:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.390+0000 7f7226ffd640 1 -- 172.21.15.96:0/1797440042 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f72180a9070 con 0x7f7230073790 2024-04-25T13:40:48.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.454+0000 7f7234dfe640 1 -- 172.21.15.96:0/1797440042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "959e7f84-6fc5-496f-bcc2-2085b6070a7f", "id": 7} v 0) -- 0x7f7230152310 con 0x7f7230073790 2024-04-25T13:40:48.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.458+0000 7f7226ffd640 1 -- 172.21.15.96:0/1797440042 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "959e7f84-6fc5-496f-bcc2-2085b6070a7f", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f7218016070 con 0x7f7230073790 2024-04-25T13:40:48.461 INFO:teuthology.orchestra.run.smithi096.stdout:7 2024-04-25T13:40:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.462+0000 7f7234dfe640 1 -- 172.21.15.96:0/1797440042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7230073790 msgr2=0x7f72301eb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.462+0000 7f7234dfe640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7230073790 0x7f72301eb9a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f721801c960 tx=0x7f7218019220 comp rx=0 tx=0).stop 2024-04-25T13:40:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.462+0000 7f7234dfe640 1 -- 172.21.15.96:0/1797440042 shutdown_connections 2024-04-25T13:40:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.462+0000 7f7234dfe640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72300a8f80 0x7f7230143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.462+0000 7f7234dfe640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7230074570 0x7f7230142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.462+0000 7f7234dfe640 1 --2- 172.21.15.96:0/1797440042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7230073790 0x7f72301eb9a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.462+0000 7f7234dfe640 1 -- 172.21.15.96:0/1797440042 >> 172.21.15.96:0/1797440042 conn(0x7f72300c4ae0 msgr2=0x7f723014cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.462+0000 7f7234dfe640 1 -- 172.21.15.96:0/1797440042 shutdown_connections 2024-04-25T13:40:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-25T13:40:48.462+0000 7f7234dfe640 1 -- 172.21.15.96:0/1797440042 wait complete. 2024-04-25T13:40:48.479 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T13:40:48.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T13:40:48.481 INFO:tasks.ceph.osd.0:Started 2024-04-25T13:40:48.481 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T13:40:48.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T13:40:48.483 INFO:tasks.ceph.osd.1:Started 2024-04-25T13:40:48.483 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T13:40:48.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T13:40:48.485 INFO:tasks.ceph.osd.2:Started 2024-04-25T13:40:48.486 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T13:40:48.486 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T13:40:48.488 INFO:tasks.ceph.osd.3:Started 2024-04-25T13:40:48.488 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T13:40:48.488 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T13:40:48.490 INFO:tasks.ceph.osd.4:Started 2024-04-25T13:40:48.490 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T13:40:48.490 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T13:40:48.493 INFO:tasks.ceph.osd.5:Started 2024-04-25T13:40:48.493 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T13:40:48.493 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T13:40:48.495 INFO:tasks.ceph.osd.6:Started 2024-04-25T13:40:48.495 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T13:40:48.495 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T13:40:48.497 INFO:tasks.ceph.osd.7:Started 2024-04-25T13:40:48.498 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:40:48.508 INFO:tasks.ceph.mgr.x.smithi096.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T13:40:48.508 INFO:tasks.ceph.mgr.x.smithi096.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T13:40:48.508 INFO:tasks.ceph.mgr.x.smithi096.stderr: from numpy import show_config as show_numpy_config 2024-04-25T13:40:48.560 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:48.558+0000 7fc485ee8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:40:48.632 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:48.632+0000 7fd71d5d4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:40:48.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.680+0000 7fdd51987640 1 Processor -- start 2024-04-25T13:40:48.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.680+0000 7fdd51987640 1 -- start start 2024-04-25T13:40:48.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd51987640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c0a85f0 0x7fdd4c14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd51987640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd4c0a4370 0x7fdd4c06c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd51987640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdd4c06caf0 0x7fdd4c150840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd51987640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4c1503b0 con 0x7fdd4c0a4370 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd51987640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4c1500c0 con 0x7fdd4c06caf0 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd51987640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c0a83d0 con 0x7fdd4c0a85f0 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd4c0a4370 0x7fdd4c06c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd4c0a4370 0x7fdd4c06c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56848/0 (socket says 172.21.15.77:56848) 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4a7fc640 1 -- 172.21.15.77:0/3086774290 learned_addr learned my addr 172.21.15.77:0/3086774290 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4b7fe640 1 --2- 172.21.15.77:0/3086774290 >> v2:172.21.15.96:3300/0 conn(0x7fdd4c06caf0 0x7fdd4c150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4affd640 1 --2- 172.21.15.77:0/3086774290 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c0a85f0 0x7fdd4c14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4a7fc640 1 -- 172.21.15.77:0/3086774290 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c0a85f0 msgr2=0x7fdd4c14fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4a7fc640 1 --2- 172.21.15.77:0/3086774290 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c0a85f0 0x7fdd4c14fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4a7fc640 1 -- 172.21.15.77:0/3086774290 >> v2:172.21.15.96:3300/0 conn(0x7fdd4c06caf0 msgr2=0x7fdd4c150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4a7fc640 1 --2- 172.21.15.77:0/3086774290 >> v2:172.21.15.96:3300/0 conn(0x7fdd4c06caf0 0x7fdd4c150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.684+0000 7fdd4a7fc640 1 -- 172.21.15.77:0/3086774290 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c154310 con 0x7fdd4c0a4370 2024-04-25T13:40:48.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd4a7fc640 1 --2- 172.21.15.77:0/3086774290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 0x7fdd4c06c5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c071540 tx=0x7fdd3c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818a94dd5c3e6f4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:48.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd49ffb640 1 -- 172.21.15.77:0/3086774290 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0b0070 con 0x7fdd4c0a4370 2024-04-25T13:40:48.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd49ffb640 1 -- 172.21.15.77:0/3086774290 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0ab600 con 0x7fdd4c0a4370 2024-04-25T13:40:48.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd49ffb640 1 -- 172.21.15.77:0/3086774290 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0ab9d0 con 0x7fdd4c0a4370 2024-04-25T13:40:48.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 -- 172.21.15.77:0/3086774290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 msgr2=0x7fdd4c06c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 --2- 172.21.15.77:0/3086774290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 0x7fdd4c06c5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c071540 tx=0x7fdd3c01c520 comp rx=0 tx=0).stop 2024-04-25T13:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 -- 172.21.15.77:0/3086774290 shutdown_connections 2024-04-25T13:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 --2- 172.21.15.77:0/3086774290 >> v2:172.21.15.96:3300/0 conn(0x7fdd4c06caf0 0x7fdd4c150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 --2- 172.21.15.77:0/3086774290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 0x7fdd4c06c5b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 --2- 172.21.15.77:0/3086774290 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c0a85f0 0x7fdd4c14fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 -- 172.21.15.77:0/3086774290 >> 172.21.15.77:0/3086774290 conn(0x7fdd4c0c48b0 msgr2=0x7fdd4c0c4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 -- 172.21.15.77:0/3086774290 shutdown_connections 2024-04-25T13:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 -- 172.21.15.77:0/3086774290 wait complete. 2024-04-25T13:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 Processor -- start 2024-04-25T13:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.688+0000 7fdd51987640 1 -- start start 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd51987640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c06caf0 0x7fdd4c0b9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd51987640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 0x7fdd4c1ef510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd51987640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd4c0a85f0 0x7fdd4c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd51987640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c070900 con 0x7fdd4c0a4370 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd51987640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c070780 con 0x7fdd4c0a85f0 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd51987640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c070a80 con 0x7fdd4c06caf0 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 0x7fdd4c1ef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 0x7fdd4c1ef510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56864/0 (socket says 172.21.15.77:56864) 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4a7fc640 1 -- 172.21.15.77:0/4115381074 learned_addr learned my addr 172.21.15.77:0/4115381074 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:48.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4b7fe640 1 --2- 172.21.15.77:0/4115381074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd4c0a85f0 0x7fdd4c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4affd640 1 --2- 172.21.15.77:0/4115381074 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c06caf0 0x7fdd4c0b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4a7fc640 1 -- 172.21.15.77:0/4115381074 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c06caf0 msgr2=0x7fdd4c0b9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4a7fc640 1 --2- 172.21.15.77:0/4115381074 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c06caf0 0x7fdd4c0b9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4a7fc640 1 -- 172.21.15.77:0/4115381074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd4c0a85f0 msgr2=0x7fdd4c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4a7fc640 1 --2- 172.21.15.77:0/4115381074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd4c0a85f0 0x7fdd4c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4a7fc640 1 -- 172.21.15.77:0/4115381074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c0bb840 con 0x7fdd4c0a4370 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd4a7fc640 1 --2- 172.21.15.77:0/4115381074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 0x7fdd4c1ef510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01abd0 tx=0x7fdd3c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd33fff640 1 -- 172.21.15.77:0/4115381074 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0ba070 con 0x7fdd4c0a4370 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd33fff640 1 -- 172.21.15.77:0/4115381074 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0b4620 con 0x7fdd4c0a4370 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd51987640 1 -- 172.21.15.77:0/4115381074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c1ec570 con 0x7fdd4c0a4370 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd33fff640 1 -- 172.21.15.77:0/4115381074 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0b0040 con 0x7fdd4c0a4370 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd51987640 1 -- 172.21.15.77:0/4115381074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c1efa50 con 0x7fdd4c0a4370 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd33fff640 1 -- 172.21.15.77:0/4115381074 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdd3c0bd070 con 0x7fdd4c0a4370 2024-04-25T13:40:48.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd33fff640 1 -- 172.21.15.77:0/4115381074 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fdd3c0b3a90 con 0x7fdd4c0a4370 2024-04-25T13:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.692+0000 7fdd51987640 1 -- 172.21.15.77:0/4115381074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4c0bba90 con 0x7fdd4c0a4370 2024-04-25T13:40:48.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.696+0000 7fdd33fff640 1 -- 172.21.15.77:0/4115381074 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fdd3c016110 con 0x7fdd4c0a4370 2024-04-25T13:40:48.718 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:48.718+0000 7fc485ee8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:40:48.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 -- 172.21.15.77:0/4115381074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd4c06a280 con 0x7fdd4c0a4370 2024-04-25T13:40:48.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd33fff640 1 -- 172.21.15.77:0/4115381074 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fdd3c0b3d70 con 0x7fdd4c0a4370 2024-04-25T13:40:48.752 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:48.752 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:40:48.459589+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:40:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 -- 172.21.15.77:0/4115381074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 msgr2=0x7fdd4c1ef510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 --2- 172.21.15.77:0/4115381074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 0x7fdd4c1ef510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01abd0 tx=0x7fdd3c0192c0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 -- 172.21.15.77:0/4115381074 shutdown_connections 2024-04-25T13:40:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 --2- 172.21.15.77:0/4115381074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd4c0a85f0 0x7fdd4c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 --2- 172.21.15.77:0/4115381074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd4c0a4370 0x7fdd4c1ef510 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 --2- 172.21.15.77:0/4115381074 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd4c06caf0 0x7fdd4c0b9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 -- 172.21.15.77:0/4115381074 >> 172.21.15.77:0/4115381074 conn(0x7fdd4c0c48b0 msgr2=0x7fdd4c14cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 -- 172.21.15.77:0/4115381074 shutdown_connections 2024-04-25T13:40:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:48.752+0000 7fdd51987640 1 -- 172.21.15.77:0/4115381074 wait complete. 2024-04-25T13:40:48.771 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T13:40:48.771 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T13:40:48.800 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:48.800+0000 7fd71d5d4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:40:48.864 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:48.864+0000 7fd71d5d4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:40:48.886 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:48.886+0000 7fc485ee8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:40:48.956 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:48.954+0000 7fc485ee8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:40:48.999 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:49.000+0000 7fd71d5d4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:40:49.103 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:49.102+0000 7fc485ee8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:40:49.116 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-25T13:40:49.116+0000 7fe83bce97c0 -1 Falling back to public interface 2024-04-25T13:40:49.132 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-25T13:40:49.130+0000 7fa7347967c0 -1 Falling back to public interface 2024-04-25T13:40:49.139 INFO:tasks.ceph.osd.6.smithi096.stderr:2024-04-25T13:40:49.138+0000 7f8513b797c0 -1 Falling back to public interface 2024-04-25T13:40:49.140 INFO:tasks.ceph.osd.7.smithi096.stderr:2024-04-25T13:40:49.138+0000 7fa1a47f37c0 -1 Falling back to public interface 2024-04-25T13:40:49.155 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-25T13:40:49.156+0000 7f29c151a7c0 -1 Falling back to public interface 2024-04-25T13:40:49.155 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-25T13:40:49.156+0000 7f62270c47c0 -1 Falling back to public interface 2024-04-25T13:40:49.156 INFO:tasks.ceph.osd.4.smithi096.stderr:2024-04-25T13:40:49.154+0000 7fe392bb77c0 -1 Falling back to public interface 2024-04-25T13:40:49.159 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-25T13:40:49.160+0000 7ff8fc4707c0 -1 Falling back to public interface 2024-04-25T13:40:49.575 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:40:49.600 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:49.600+0000 7fd71d5d4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:40:49.680 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:49.680+0000 7fd71d5d4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:40:49.711 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ef607640 1 Processor -- start 2024-04-25T13:40:49.711 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ef607640 1 -- start start 2024-04-25T13:40:49.713 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ef607640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4e80a8e10 0x7fb4e80c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:49.714 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ef607640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e8070740 con 0x7fb4e81518a0 2024-04-25T13:40:49.714 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ef607640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e8070a20 con 0x7fb4e8155c20 2024-04-25T13:40:49.714 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ef607640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb4e80c1940 con 0x7fb4e80a8e10 2024-04-25T13:40:49.714 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ed3a3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4e80a8e10 0x7fb4e80c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:49.714 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4edba4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb4e81518a0 0x7fb4e8151cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36928/0 (socket says 172.21.15.77:36928) 2024-04-25T13:40:49.714 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4edba4640 1 -- 172.21.15.77:0/404945149 learned_addr learned my addr 172.21.15.77:0/404945149 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:40:49.714 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ed3a3640 1 -- 172.21.15.77:0/404945149 >> v1:172.21.15.96:6789/0 conn(0x7fb4e8155c20 legacy=0x7fb4e8156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:49.714 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ed3a3640 1 -- 172.21.15.77:0/404945149 >> v1:172.21.15.77:6789/0 conn(0x7fb4e81518a0 legacy=0x7fb4e8151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:49.714 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.712+0000 7fb4ed3a3640 1 -- 172.21.15.77:0/404945149 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e8071110 con 0x7fb4e80a8e10 2024-04-25T13:40:49.716 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4ed3a3640 1 --2- 172.21.15.77:0/404945149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e80a8e10 0x7fb4e80c1400 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009d90 tx=0x7fb4dc01f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1cc710b832b343 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:49.716 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4dbfff640 1 -- 172.21.15.77:0/404945149 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0b4070 con 0x7fb4e80a8e10 2024-04-25T13:40:49.716 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4dbfff640 1 -- 172.21.15.77:0/404945149 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4dc0af600 con 0x7fb4e80a8e10 2024-04-25T13:40:49.716 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4dbfff640 1 -- 172.21.15.77:0/404945149 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0af9d0 con 0x7fb4e80a8e10 2024-04-25T13:40:49.717 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4ef607640 1 -- 172.21.15.77:0/404945149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e80a8e10 msgr2=0x7fb4e80c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:49.717 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4ef607640 1 --2- 172.21.15.77:0/404945149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e80a8e10 0x7fb4e80c1400 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009d90 tx=0x7fb4dc01f120 comp rx=0 tx=0).stop 2024-04-25T13:40:49.717 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4ef607640 1 -- 172.21.15.77:0/404945149 shutdown_connections 2024-04-25T13:40:49.717 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4ef607640 1 --2- 172.21.15.77:0/404945149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e80a8e10 0x7fb4e80c1400 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:49.717 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4ef607640 1 -- 172.21.15.77:0/404945149 >> 172.21.15.77:0/404945149 conn(0x7fb4e80a65f0 msgr2=0x7fb4e80a6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:49.717 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4ef607640 1 -- 172.21.15.77:0/404945149 shutdown_connections 2024-04-25T13:40:49.717 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.716+0000 7fb4ef607640 1 -- 172.21.15.77:0/404945149 wait complete. 2024-04-25T13:40:49.719 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 Processor -- start 2024-04-25T13:40:49.719 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 -- start start 2024-04-25T13:40:49.722 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb4e80a8e10 0x7fb4e8145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:49.722 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e81518a0 0x7fb4e81546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4e8155c20 0x7fb4e80bd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e8152540 con 0x7fb4e81518a0 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e81523c0 con 0x7fb4e8155c20 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e815dc80 con 0x7fb4e80a8e10 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ecba2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e81518a0 0x7fb4e81546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ecba2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e81518a0 0x7fb4e81546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56884/0 (socket says 172.21.15.77:56884) 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ecba2640 1 -- 172.21.15.77:0/1008892533 learned_addr learned my addr 172.21.15.77:0/1008892533 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ed3a3640 1 --2- 172.21.15.77:0/1008892533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb4e80a8e10 0x7fb4e8145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4edba4640 1 --2- 172.21.15.77:0/1008892533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4e8155c20 0x7fb4e80bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ecba2640 1 -- 172.21.15.77:0/1008892533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb4e80a8e10 msgr2=0x7fb4e8145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ecba2640 1 --2- 172.21.15.77:0/1008892533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb4e80a8e10 0x7fb4e8145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:49.723 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ecba2640 1 -- 172.21.15.77:0/1008892533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4e8155c20 msgr2=0x7fb4e80bd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ecba2640 1 --2- 172.21.15.77:0/1008892533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4e8155c20 0x7fb4e80bd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ecba2640 1 -- 172.21.15.77:0/1008892533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e81eb8f0 con 0x7fb4e81518a0 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ecba2640 1 --2- 172.21.15.77:0/1008892533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e81518a0 0x7fb4e81546f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400b410 tx=0x7fb4e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4d9ffb640 1 -- 172.21.15.77:0/1008892533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4015030 con 0x7fb4e81518a0 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4d9ffb640 1 -- 172.21.15.77:0/1008892533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e4004020 con 0x7fb4e81518a0 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 -- 172.21.15.77:0/1008892533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e81ebbd0 con 0x7fb4e81518a0 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4d9ffb640 1 -- 172.21.15.77:0/1008892533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4004410 con 0x7fb4e81518a0 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4ef607640 1 -- 172.21.15.77:0/1008892533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e80c0580 con 0x7fb4e81518a0 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4d9ffb640 1 -- 172.21.15.77:0/1008892533 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb4e4018070 con 0x7fb4e81518a0 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.720+0000 7fb4d9ffb640 1 -- 172.21.15.77:0/1008892533 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb4e401aae0 con 0x7fb4e81518a0 2024-04-25T13:40:49.724 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.724+0000 7fb4ef607640 1 -- 172.21.15.77:0/1008892533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e806a1a0 con 0x7fb4e81518a0 2024-04-25T13:40:49.725 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.724+0000 7fb4d9ffb640 1 -- 172.21.15.77:0/1008892533 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb4e401ad30 con 0x7fb4e81518a0 2024-04-25T13:40:49.728 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:49.726+0000 7fc485ee8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:40:49.795 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 -- 172.21.15.77:0/1008892533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4e80c0340 con 0x7fb4e81518a0 2024-04-25T13:40:49.796 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4d9ffb640 1 -- 172.21.15.77:0/1008892533 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb4e4003ab0 con 0x7fb4e81518a0 2024-04-25T13:40:49.796 INFO:teuthology.misc.health.smithi077.stdout: 2024-04-25T13:40:49.796 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":10,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:40:48.459589+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:40:49.797 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 -- 172.21.15.77:0/1008892533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e81518a0 msgr2=0x7fb4e81546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:49.797 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 --2- 172.21.15.77:0/1008892533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e81518a0 0x7fb4e81546f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400b410 tx=0x7fb4e400b8d0 comp rx=0 tx=0).stop 2024-04-25T13:40:49.797 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 -- 172.21.15.77:0/1008892533 shutdown_connections 2024-04-25T13:40:49.797 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 --2- 172.21.15.77:0/1008892533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4e8155c20 0x7fb4e80bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:49.797 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 --2- 172.21.15.77:0/1008892533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e81518a0 0x7fb4e81546f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:49.797 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 --2- 172.21.15.77:0/1008892533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb4e80a8e10 0x7fb4e8145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:49.797 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 -- 172.21.15.77:0/1008892533 >> 172.21.15.77:0/1008892533 conn(0x7fb4e80a65f0 msgr2=0x7fb4e80a6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:49.797 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 -- 172.21.15.77:0/1008892533 shutdown_connections 2024-04-25T13:40:49.798 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:49.796+0000 7fb4ef607640 1 -- 172.21.15.77:0/1008892533 wait complete. 2024-04-25T13:40:49.804 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:49.802+0000 7fc485ee8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:40:49.813 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T13:40:49.893 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:49.892+0000 7fd71d5d4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:40:49.973 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:49.972+0000 7fd71d5d4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:40:49.984 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:49.982+0000 7fc485ee8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:40:50.058 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:50.058+0000 7fc485ee8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:40:50.266 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:50.268+0000 7fd71d5d4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:40:50.328 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:50.328+0000 7fd71d5d4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:40:50.349 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:50.346+0000 7fc485ee8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:40:50.416 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-25T13:40:50.414+0000 7fc485ee8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:40:51.369 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:51.368+0000 7fd6c4088640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T13:40:51.375 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T13:40:51.376+0000 7fd6c4088640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T13:40:52.817 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-25T13:40:52.814+0000 7fa7347967c0 -1 osd.5 0 log_to_monitors true 2024-04-25T13:40:52.841 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-25T13:40:52.840+0000 7fe83bce97c0 -1 osd.2 0 log_to_monitors true 2024-04-25T13:40:52.964 INFO:tasks.ceph.osd.7.smithi096.stderr:2024-04-25T13:40:52.962+0000 7fa1a47f37c0 -1 osd.7 0 log_to_monitors true 2024-04-25T13:40:53.000 INFO:tasks.ceph.osd.6.smithi096.stderr:2024-04-25T13:40:52.998+0000 7f8513b797c0 -1 osd.6 0 log_to_monitors true 2024-04-25T13:40:53.060 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-25T13:40:53.060+0000 7f62270c47c0 -1 osd.3 0 log_to_monitors true 2024-04-25T13:40:53.062 INFO:tasks.ceph.osd.4.smithi096.stderr:2024-04-25T13:40:53.062+0000 7fe392bb77c0 -1 osd.4 0 log_to_monitors true 2024-04-25T13:40:53.069 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-25T13:40:53.068+0000 7f29c151a7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T13:40:53.086 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-25T13:40:53.088+0000 7ff8fc4707c0 -1 osd.0 0 log_to_monitors true 2024-04-25T13:40:55.574 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-25T13:40:55.574+0000 7fa73073d640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T13:40:55.577 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-25T13:40:55.575+0000 7f29bd4c1640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T13:40:55.599 INFO:tasks.ceph.osd.5.smithi096.stderr:2024-04-25T13:40:55.598+0000 7fa72853e640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:55.603 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-25T13:40:55.603+0000 7f29b52c2640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:55.605 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-25T13:40:55.603+0000 7fe837c90640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T13:40:55.606 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-25T13:40:55.607+0000 7ff8f8417640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T13:40:55.629 INFO:tasks.ceph.osd.4.smithi096.stderr:2024-04-25T13:40:55.626+0000 7fe38eb5e640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T13:40:55.635 INFO:tasks.ceph.osd.6.smithi096.stderr:2024-04-25T13:40:55.634+0000 7f850fb20640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T13:40:55.635 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-25T13:40:55.635+0000 7fe82fa91640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:55.639 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-25T13:40:55.639+0000 7ff8f0218640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:55.644 INFO:tasks.ceph.osd.7.smithi096.stderr:2024-04-25T13:40:55.642+0000 7fa1a0fae640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T13:40:55.655 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-25T13:40:55.655+0000 7f622306b640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T13:40:55.662 INFO:tasks.ceph.osd.4.smithi096.stderr:2024-04-25T13:40:55.662+0000 7fe38695f640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:55.666 INFO:tasks.ceph.osd.6.smithi096.stderr:2024-04-25T13:40:55.666+0000 7f8507921640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:55.683 INFO:tasks.ceph.osd.7.smithi096.stderr:2024-04-25T13:40:55.682+0000 7fa19859b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:55.683 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-25T13:40:55.683+0000 7f621ae6c640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:56.618 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:40:56.766 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.763+0000 7efd83776640 1 Processor -- start 2024-04-25T13:40:56.766 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.763+0000 7efd83776640 1 -- start start 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd83776640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c06f280 0x7efd7c06f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd83776640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd7c14e7c0 con 0x7efd7c151e20 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd83776640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd7c0bee10 con 0x7efd7c14efa0 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd83776640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c0a8420 con 0x7efd7c06f280 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81512640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efd7c151e20 0x7efd7c0be700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48838/0 (socket says 172.21.15.77:48838) 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81512640 1 -- 172.21.15.77:0/2969109534 learned_addr learned my addr 172.21.15.77:0/2969109534 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd80d11640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c06f280 0x7efd7c06f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815994486 0 0) 0x7efd7c14e7c0 con 0x7efd7c151e20 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd64003530 con 0x7efd7c151e20 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2836867868 0 0) 0x7efd64003530 con 0x7efd7c151e20 2024-04-25T13:40:56.770 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c06f280 msgr2=0x7efd7c06f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c06f280 0x7efd7c06f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 >> v1:172.21.15.96:6789/0 conn(0x7efd7c14efa0 legacy=0x7efd7c1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c14ea80 con 0x7efd7c151e20 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7efd74001a00 con 0x7efd7c151e20 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 >> v1:172.21.15.77:6789/0 conn(0x7efd7c151e20 legacy=0x7efd7c0be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c06f280 0x7efd640039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd64003f70 0x7efd64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd64004d50 0x7efd64005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c0a8420 con 0x7efd64004d50 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7efd6400bc10 con 0x7efd64003f70 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7efd6400e020 con 0x7efd7c06f280 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81d13640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd64004d50 0x7efd64005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd80d11640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd64003f70 0x7efd64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81512640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c06f280 0x7efd640039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81d13640 1 -- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c06f280 msgr2=0x7efd640039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:56.771 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81d13640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c06f280 0x7efd640039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.772 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81d13640 1 -- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd64003f70 msgr2=0x7efd64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:56.772 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81d13640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd64003f70 0x7efd64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.772 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81d13640 1 -- 172.21.15.77:0/2969109534 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd64003530 con 0x7efd64004d50 2024-04-25T13:40:56.772 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd81512640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c06f280 0x7efd640039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:40:56.772 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.767+0000 7efd80d11640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd64003f70 0x7efd64004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd81d13640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd64004d50 0x7efd64005160 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd6c001750 tx=0x7efd6c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1094d3a4f37b323 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0013a0 con 0x7efd64004d50 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6c0052f0 con 0x7efd64004d50 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd7bfff640 1 -- 172.21.15.77:0/2969109534 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c003840 con 0x7efd64004d50 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd83776640 1 -- 172.21.15.77:0/2969109534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd64004d50 msgr2=0x7efd64005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd83776640 1 --2- 172.21.15.77:0/2969109534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd64004d50 0x7efd64005160 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd6c001750 tx=0x7efd6c01c3e0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd81d13640 1 -- 172.21.15.77:0/2969109534 reap_dead start 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd83776640 1 -- 172.21.15.77:0/2969109534 shutdown_connections 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd83776640 1 -- 172.21.15.77:0/2969109534 >> 172.21.15.77:0/2969109534 conn(0x7efd7c0c37c0 msgr2=0x7efd7c0c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd83776640 1 -- 172.21.15.77:0/2969109534 shutdown_connections 2024-04-25T13:40:56.773 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd83776640 1 -- 172.21.15.77:0/2969109534 wait complete. 2024-04-25T13:40:56.774 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd83776640 1 Processor -- start 2024-04-25T13:40:56.774 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.771+0000 7efd83776640 1 -- start start 2024-04-25T13:40:56.776 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd83776640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c0be550 0x7efd7c1e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd83776640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd7c1d8b90 0x7efd7c1e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd83776640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c1e59b0 0x7efd7c0bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd83776640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c074830 con 0x7efd7c1e59b0 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd83776640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c0746b0 con 0x7efd7c1d8b90 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd83776640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c152230 con 0x7efd7c0be550 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81d13640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c1e59b0 0x7efd7c0bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81d13640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c1e59b0 0x7efd7c0bcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55044/0 (socket says 172.21.15.77:55044) 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81d13640 1 -- 172.21.15.77:0/1725715715 learned_addr learned my addr 172.21.15.77:0/1725715715 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81512640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c0be550 0x7efd7c1e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd80d11640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd7c1d8b90 0x7efd7c1e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81d13640 1 -- 172.21.15.77:0/1725715715 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c0be550 msgr2=0x7efd7c1e8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:56.777 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81d13640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c0be550 0x7efd7c1e8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81d13640 1 -- 172.21.15.77:0/1725715715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd7c1d8b90 msgr2=0x7efd7c1e5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81d13640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd7c1d8b90 0x7efd7c1e5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81d13640 1 -- 172.21.15.77:0/1725715715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c073fc0 con 0x7efd7c1e59b0 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd80d11640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd7c1d8b90 0x7efd7c1e5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81d13640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c1e59b0 0x7efd7c0bcb60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd6c001750 tx=0x7efd64005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd79ffb640 1 -- 172.21.15.77:0/1725715715 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0013a0 con 0x7efd7c1e59b0 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd79ffb640 1 -- 172.21.15.77:0/1725715715 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6c0ba070 con 0x7efd7c1e59b0 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd79ffb640 1 -- 172.21.15.77:0/1725715715 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c007a40 con 0x7efd7c1e59b0 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7c09d280 con 0x7efd7c1e59b0 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7c09ba60 con 0x7efd7c1e59b0 2024-04-25T13:40:56.778 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7c06a1a0 con 0x7efd7c1e59b0 2024-04-25T13:40:56.779 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd79ffb640 1 -- 172.21.15.77:0/1725715715 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7efd6c0052f0 con 0x7efd7c1e59b0 2024-04-25T13:40:56.779 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd79ffb640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd6806f370 0x7efd68071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:56.779 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd79ffb640 1 -- 172.21.15.77:0/1725715715 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7efd6c128c20 con 0x7efd7c1e59b0 2024-04-25T13:40:56.779 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.775+0000 7efd81512640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd6806f370 0x7efd68071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:56.779 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.779+0000 7efd81512640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd6806f370 0x7efd68071880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd7c09dab0 tx=0x7efd74001960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:56.783 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.783+0000 7efd79ffb640 1 -- 172.21.15.77:0/1725715715 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd6c0160f0 con 0x7efd7c1e59b0 2024-04-25T13:40:56.933 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.931+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd7c0a7780 con 0x7efd7c1e59b0 2024-04-25T13:40:56.935 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd79ffb640 1 -- 172.21.15.77:0/1725715715 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10861 (secure 0 0 0) 0x7efd6c0f6140 con 0x7efd7c1e59b0 2024-04-25T13:40:56.935 INFO:teuthology.misc.health.smithi077.stdout: 2024-04-25T13:40:56.935 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":13,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:40:56.618717+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd6806f370 msgr2=0x7efd68071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd6806f370 0x7efd68071880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd7c09dab0 tx=0x7efd74001960 comp rx=0 tx=0).stop 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c1e59b0 msgr2=0x7efd7c0bcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c1e59b0 0x7efd7c0bcb60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd6c001750 tx=0x7efd64005840 comp rx=0 tx=0).stop 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 shutdown_connections 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd6806f370 0x7efd68071880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c1e59b0 0x7efd7c0bcb60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd7c1d8b90 0x7efd7c1e5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 --2- 172.21.15.77:0/1725715715 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd7c0be550 0x7efd7c1e8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:56.937 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 >> 172.21.15.77:0/1725715715 conn(0x7efd7c0c37c0 msgr2=0x7efd7c072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:56.938 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 shutdown_connections 2024-04-25T13:40:56.938 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T13:40:56.935+0000 7efd83776640 1 -- 172.21.15.77:0/1725715715 wait complete. 2024-04-25T13:40:56.952 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T13:40:56.953 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T13:40:56.953 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T13:40:56.953 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T13:40:56.955 INFO:tasks.ceph.mds.a:Started 2024-04-25T13:40:56.955 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T13:40:56.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T13:40:56.958 INFO:tasks.ceph.mds.b:Started 2024-04-25T13:40:56.958 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T13:40:56.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:40:57.065 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2024-04-25T13:40:57.088 INFO:tasks.ceph.mds.b.smithi096.stdout:starting mds.b at 2024-04-25T13:40:57.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f357e51d640 1 Processor -- start 2024-04-25T13:40:57.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f357e51d640 1 -- start start 2024-04-25T13:40:57.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f357e51d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3578152fe0 0x7f3578070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f357e51d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f357814e710 0x7f357814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f357e51d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35780a6270 con 0x7f3578072a10 2024-04-25T13:40:57.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f357e51d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f357814f060 con 0x7f3578152fe0 2024-04-25T13:40:57.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f357e51d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f35781533f0 con 0x7f357814e710 2024-04-25T13:40:57.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f3577fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3578152fe0 0x7f3578070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f3577fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3578152fe0 0x7f3578070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55060/0 (socket says 172.21.15.77:55060) 2024-04-25T13:40:57.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f3577fff640 1 -- 172.21.15.77:0/425568063 learned_addr learned my addr 172.21.15.77:0/425568063 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:57.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f356f7fe640 1 --2- 172.21.15.77:0/425568063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f357814e710 0x7f357814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f3577fff640 1 -- 172.21.15.77:0/425568063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f357814e710 msgr2=0x7f357814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:57.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f3577fff640 1 --2- 172.21.15.77:0/425568063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f357814e710 0x7f357814eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f3577fff640 1 -- 172.21.15.77:0/425568063 >> v1:172.21.15.96:6789/0 conn(0x7f3578072a10 legacy=0x7f3578072e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.095+0000 7f3577fff640 1 -- 172.21.15.77:0/425568063 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35780a6550 con 0x7f3578152fe0 2024-04-25T13:40:57.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f3577fff640 1 --2- 172.21.15.77:0/425568063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3578152fe0 0x7f3578070cb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3568006fd0 tx=0x7f356801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8515a3228e1de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:57.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f35777fe640 1 -- 172.21.15.77:0/425568063 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35680b0070 con 0x7f3578152fe0 2024-04-25T13:40:57.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f35777fe640 1 -- 172.21.15.77:0/425568063 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35680ab600 con 0x7f3578152fe0 2024-04-25T13:40:57.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f35777fe640 1 -- 172.21.15.77:0/425568063 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35680ab9d0 con 0x7f3578152fe0 2024-04-25T13:40:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f357e51d640 1 -- 172.21.15.77:0/425568063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3578152fe0 msgr2=0x7f3578070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f357e51d640 1 --2- 172.21.15.77:0/425568063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3578152fe0 0x7f3578070cb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3568006fd0 tx=0x7f356801c420 comp rx=0 tx=0).stop 2024-04-25T13:40:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f357e51d640 1 -- 172.21.15.77:0/425568063 shutdown_connections 2024-04-25T13:40:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f357e51d640 1 --2- 172.21.15.77:0/425568063 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f357814e710 0x7f357814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f357e51d640 1 --2- 172.21.15.77:0/425568063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3578152fe0 0x7f3578070cb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f357e51d640 1 -- 172.21.15.77:0/425568063 >> 172.21.15.77:0/425568063 conn(0x7f35780c11e0 msgr2=0x7f35780c15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f357e51d640 1 -- 172.21.15.77:0/425568063 shutdown_connections 2024-04-25T13:40:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.099+0000 7f357e51d640 1 -- 172.21.15.77:0/425568063 wait complete. 2024-04-25T13:40:57.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 Processor -- start 2024-04-25T13:40:57.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 -- start start 2024-04-25T13:40:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3578072a10 0x7f357814d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357814e710 0x7f35781478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3578152fe0 0x7f3578147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f357815c4e0 con 0x7f357814e710 2024-04-25T13:40:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f357815c360 con 0x7f3578152fe0 2024-04-25T13:40:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f357815c660 con 0x7f3578072a10 2024-04-25T13:40:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357814e710 0x7f35781478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357814e710 0x7f35781478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55076/0 (socket says 172.21.15.77:55076) 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f356f7fe640 1 -- 172.21.15.77:0/2714095983 learned_addr learned my addr 172.21.15.77:0/2714095983 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f3577fff640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3578072a10 0x7f357814d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357caba640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3578152fe0 0x7f3578147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f356f7fe640 1 -- 172.21.15.77:0/2714095983 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3578072a10 msgr2=0x7f357814d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f356f7fe640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3578072a10 0x7f357814d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f356f7fe640 1 -- 172.21.15.77:0/2714095983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3578152fe0 msgr2=0x7f3578147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f356f7fe640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3578152fe0 0x7f3578147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f356f7fe640 1 -- 172.21.15.77:0/2714095983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35781ea030 con 0x7f357814e710 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f356f7fe640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357814e710 0x7f35781478c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f356000e8a0 tx=0x7f356000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f35757fa640 1 -- 172.21.15.77:0/2714095983 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560017070 con 0x7f357814e710 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f35757fa640 1 -- 172.21.15.77:0/2714095983 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356000c940 con 0x7f357814e710 2024-04-25T13:40:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3578153c30 con 0x7f357814e710 2024-04-25T13:40:57.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f35757fa640 1 -- 172.21.15.77:0/2714095983 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356000ccf0 con 0x7f357814e710 2024-04-25T13:40:57.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3578153e70 con 0x7f357814e710 2024-04-25T13:40:57.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f357806a280 con 0x7f357814e710 2024-04-25T13:40:57.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f35757fa640 1 -- 172.21.15.77:0/2714095983 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f356001a070 con 0x7f357814e710 2024-04-25T13:40:57.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.103+0000 7f35757fa640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f355806f370 0x7f3558071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.107+0000 7f35757fa640 1 -- 172.21.15.77:0/2714095983 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f356008ead0 con 0x7f357814e710 2024-04-25T13:40:57.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.107+0000 7f3577fff640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f355806f370 0x7f3558071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.107+0000 7f3577fff640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f355806f370 0x7f3558071880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f35680ad000 tx=0x7f35680a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:57.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.111+0000 7f35757fa640 1 -- 172.21.15.77:0/2714095983 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f356005b9b0 con 0x7f357814e710 2024-04-25T13:40:57.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.263+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35780706a0 con 0x7f357814e710 2024-04-25T13:40:57.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.263+0000 7f35757fa640 1 -- 172.21.15.77:0/2714095983 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10861 (secure 0 0 0) 0x7f356005fcb0 con 0x7f357814e710 2024-04-25T13:40:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:57.266 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":13,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:40:56.618717+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:40:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f355806f370 msgr2=0x7f3558071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f355806f370 0x7f3558071880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f35680ad000 tx=0x7f35680a6000 comp rx=0 tx=0).stop 2024-04-25T13:40:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357814e710 msgr2=0x7f35781478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357814e710 0x7f35781478c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f356000e8a0 tx=0x7f356000eca0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 shutdown_connections 2024-04-25T13:40:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f355806f370 0x7f3558071880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3578152fe0 0x7f3578147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f357814e710 0x7f35781478c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 --2- 172.21.15.77:0/2714095983 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3578072a10 0x7f357814d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 >> 172.21.15.77:0/2714095983 conn(0x7f35780c11e0 msgr2=0x7f35780c15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:57.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 shutdown_connections 2024-04-25T13:40:57.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.267+0000 7f357e51d640 1 -- 172.21.15.77:0/2714095983 wait complete. 2024-04-25T13:40:57.285 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-25T13:40:57.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:40:57.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.419+0000 7f95bed54640 1 Processor -- start 2024-04-25T13:40:57.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.419+0000 7f95bed54640 1 -- start start 2024-04-25T13:40:57.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95bed54640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f95b8146cb0 0x7f95b8071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95bed54640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b81470c0 con 0x7f95b80b85f0 2024-04-25T13:40:57.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95bed54640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b8150ff0 con 0x7f95b8073bc0 2024-04-25T13:40:57.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95bed54640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f95b80733c0 con 0x7f95b8146cb0 2024-04-25T13:40:57.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95bcaf0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f95b80b85f0 0x7f95b806f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48864/0 (socket says 172.21.15.77:48864) 2024-04-25T13:40:57.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95bcaf0640 1 -- 172.21.15.77:0/3559930437 learned_addr learned my addr 172.21.15.77:0/3559930437 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:40:57.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b7fff640 1 --2- 172.21.15.77:0/3559930437 >> v2:172.21.15.77:3300/0 conn(0x7f95b8146cb0 0x7f95b8071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b77fe640 1 -- 172.21.15.77:0/3559930437 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242163619 0 0) 0x7f95b81470c0 con 0x7f95b80b85f0 2024-04-25T13:40:57.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b77fe640 1 -- 172.21.15.77:0/3559930437 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95a0003530 con 0x7f95b80b85f0 2024-04-25T13:40:57.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b7fff640 1 -- 172.21.15.77:0/3559930437 >> v1:172.21.15.96:6789/0 conn(0x7f95b8073bc0 legacy=0x7f95b8073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:57.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b7fff640 1 -- 172.21.15.77:0/3559930437 >> v1:172.21.15.77:6789/0 conn(0x7f95b80b85f0 legacy=0x7f95b806f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b7fff640 1 -- 172.21.15.77:0/3559930437 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b80736a0 con 0x7f95b8146cb0 2024-04-25T13:40:57.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b7fff640 1 --2- 172.21.15.77:0/3559930437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b8146cb0 0x7f95b8071900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0097c0 tx=0x7f95ac01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f4b24419f71c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:57.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b77fe640 1 -- 172.21.15.77:0/3559930437 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0b1070 con 0x7f95b8146cb0 2024-04-25T13:40:57.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b77fe640 1 -- 172.21.15.77:0/3559930437 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac0ac5f0 con 0x7f95b8146cb0 2024-04-25T13:40:57.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.423+0000 7f95b77fe640 1 -- 172.21.15.77:0/3559930437 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0ac9c0 con 0x7f95b8146cb0 2024-04-25T13:40:57.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 -- 172.21.15.77:0/3559930437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b8146cb0 msgr2=0x7f95b8071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 --2- 172.21.15.77:0/3559930437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b8146cb0 0x7f95b8071900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0097c0 tx=0x7f95ac01c370 comp rx=0 tx=0).stop 2024-04-25T13:40:57.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 -- 172.21.15.77:0/3559930437 shutdown_connections 2024-04-25T13:40:57.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 --2- 172.21.15.77:0/3559930437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b8146cb0 0x7f95b8071900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 -- 172.21.15.77:0/3559930437 >> 172.21.15.77:0/3559930437 conn(0x7f95b80c02a0 msgr2=0x7f95b80c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:57.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 -- 172.21.15.77:0/3559930437 shutdown_connections 2024-04-25T13:40:57.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 -- 172.21.15.77:0/3559930437 wait complete. 2024-04-25T13:40:57.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 Processor -- start 2024-04-25T13:40:57.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 -- start start 2024-04-25T13:40:57.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b8073bc0 0x7f95b80a7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b80b85f0 0x7f95b80bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95b8146cb0 0x7f95b813c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f95b815eb70 con 0x7f95b80b85f0 2024-04-25T13:40:57.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f95b815e9f0 con 0x7f95b8073bc0 2024-04-25T13:40:57.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bed54640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f95b815ecf0 con 0x7f95b8146cb0 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b80b85f0 0x7f95b80bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b80b85f0 0x7f95b80bdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55102/0 (socket says 172.21.15.77:55102) 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95b7fff640 1 -- 172.21.15.77:0/1185525192 learned_addr learned my addr 172.21.15.77:0/1185525192 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bcaf0640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b8073bc0 0x7f95b80a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bd2f1640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95b8146cb0 0x7f95b813c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95b7fff640 1 -- 172.21.15.77:0/1185525192 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95b8146cb0 msgr2=0x7f95b813c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95b7fff640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95b8146cb0 0x7f95b813c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95b7fff640 1 -- 172.21.15.77:0/1185525192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b8073bc0 msgr2=0x7f95b80a7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95b7fff640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b8073bc0 0x7f95b80a7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95b7fff640 1 -- 172.21.15.77:0/1185525192 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b80a68f0 con 0x7f95b80b85f0 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.427+0000 7f95bcaf0640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b8073bc0 0x7f95b80a7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95b7fff640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b80b85f0 0x7f95b80bdd10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0af040 tx=0x7f95ac019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95b57fa640 1 -- 172.21.15.77:0/1185525192 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0b1040 con 0x7f95b80b85f0 2024-04-25T13:40:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95b57fa640 1 -- 172.21.15.77:0/1185525192 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac0bb070 con 0x7f95b80b85f0 2024-04-25T13:40:57.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95b57fa640 1 -- 172.21.15.77:0/1185525192 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0b5410 con 0x7f95b80b85f0 2024-04-25T13:40:57.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b80a7a70 con 0x7f95b80b85f0 2024-04-25T13:40:57.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b80a6e10 con 0x7f95b80b85f0 2024-04-25T13:40:57.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b80a6c00 con 0x7f95b80b85f0 2024-04-25T13:40:57.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95b57fa640 1 -- 172.21.15.77:0/1185525192 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f95ac0b55b0 con 0x7f95b80b85f0 2024-04-25T13:40:57.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95b57fa640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f95a406f370 0x7f95a4071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:57.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95bcaf0640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f95a406f370 0x7f95a4071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:57.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95b57fa640 1 -- 172.21.15.77:0/1185525192 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f95ac1288f0 con 0x7f95b80b85f0 2024-04-25T13:40:57.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.431+0000 7f95bcaf0640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f95a406f370 0x7f95a4071880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001370 tx=0x7f95a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:57.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.435+0000 7f95b57fa640 1 -- 172.21.15.77:0/1185525192 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95ac0a9070 con 0x7f95b80b85f0 2024-04-25T13:40:57.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.631+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95b806a280 con 0x7f95b80b85f0 2024-04-25T13:40:57.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95b57fa640 1 -- 172.21.15.77:0/1185525192 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f95ac016050 con 0x7f95b80b85f0 2024-04-25T13:40:57.636 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:40:57.636 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2393103049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2393103049},{"type":"v1","addr":"172.21.15.77:6835","nonce":2393103049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T13:40:57.636 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f95a406f370 msgr2=0x7f95a4071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f95a406f370 0x7f95a4071880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001370 tx=0x7f95a8009040 comp rx=0 tx=0).stop 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b80b85f0 msgr2=0x7f95b80bdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b80b85f0 0x7f95b80bdd10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0af040 tx=0x7f95ac019170 comp rx=0 tx=0).stop 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 shutdown_connections 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f95a406f370 0x7f95a4071880 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f95b8146cb0 0x7f95b813c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95b80b85f0 0x7f95b80bdd10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 --2- 172.21.15.77:0/1185525192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95b8073bc0 0x7f95b80a7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 >> 172.21.15.77:0/1185525192 conn(0x7f95b80c02a0 msgr2=0x7f95b80c1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 shutdown_connections 2024-04-25T13:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:57.635+0000 7f95bed54640 1 -- 172.21.15.77:0/1185525192 wait complete. 2024-04-25T13:40:59.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:40:59.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c70205640 1 Processor -- start 2024-04-25T13:40:59.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c70205640 1 -- start start 2024-04-25T13:40:59.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c70205640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814e9e0 0x7f7c6814edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:59.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c70205640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c6814f330 0x7f7c6814f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:59.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c70205640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c680a8900 con 0x7f7c680a5da0 2024-04-25T13:40:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c70205640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7c68074770 con 0x7f7c6814f330 2024-04-25T13:40:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c70205640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f7c680a8ba0 con 0x7f7c6814e9e0 2024-04-25T13:40:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6d7a0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814e9e0 0x7f7c6814edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6e7a2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c6814f330 0x7f7c6814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6d7a0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814e9e0 0x7f7c6814edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:35908/0 (socket says 172.21.15.77:35908) 2024-04-25T13:40:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6d7a0640 1 -- 172.21.15.77:0/1091319837 learned_addr learned my addr 172.21.15.77:0/1091319837 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6cf9f640 1 -- 172.21.15.77:0/1091319837 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712913401 0 0) 0x7f7c680a8900 con 0x7f7c680a5da0 2024-04-25T13:40:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6cf9f640 1 -- 172.21.15.77:0/1091319837 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c54003530 con 0x7f7c680a5da0 2024-04-25T13:40:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6d7a0640 1 -- 172.21.15.77:0/1091319837 >> v2:172.21.15.96:3300/0 conn(0x7f7c6814f330 msgr2=0x7f7c6814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:40:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6d7a0640 1 --2- 172.21.15.77:0/1091319837 >> v2:172.21.15.96:3300/0 conn(0x7f7c6814f330 0x7f7c6814f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6d7a0640 1 -- 172.21.15.77:0/1091319837 >> v1:172.21.15.96:6789/0 conn(0x7f7c680a5da0 legacy=0x7f7c6806f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.815+0000 7f7c6d7a0640 1 -- 172.21.15.77:0/1091319837 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c680a7c00 con 0x7f7c6814e9e0 2024-04-25T13:40:59.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c6d7a0640 1 --2- 172.21.15.77:0/1091319837 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814e9e0 0x7f7c6814edf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009870 tx=0x7f7c5801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1341f83b5318891b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:59.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c6cf9f640 1 -- 172.21.15.77:0/1091319837 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580b2070 con 0x7f7c6814e9e0 2024-04-25T13:40:59.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c6cf9f640 1 -- 172.21.15.77:0/1091319837 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c580ad680 con 0x7f7c6814e9e0 2024-04-25T13:40:59.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c6cf9f640 1 -- 172.21.15.77:0/1091319837 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580ada30 con 0x7f7c6814e9e0 2024-04-25T13:40:59.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c70205640 1 -- 172.21.15.77:0/1091319837 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814e9e0 msgr2=0x7f7c6814edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:59.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c70205640 1 --2- 172.21.15.77:0/1091319837 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814e9e0 0x7f7c6814edf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009870 tx=0x7f7c5801c4d0 comp rx=0 tx=0).stop 2024-04-25T13:40:59.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c70205640 1 -- 172.21.15.77:0/1091319837 shutdown_connections 2024-04-25T13:40:59.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c70205640 1 --2- 172.21.15.77:0/1091319837 >> v2:172.21.15.96:3300/0 conn(0x7f7c6814f330 0x7f7c6814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:59.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c70205640 1 --2- 172.21.15.77:0/1091319837 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814e9e0 0x7f7c6814edf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:59.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c70205640 1 -- 172.21.15.77:0/1091319837 >> 172.21.15.77:0/1091319837 conn(0x7f7c680c02a0 msgr2=0x7f7c680c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:59.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c70205640 1 -- 172.21.15.77:0/1091319837 shutdown_connections 2024-04-25T13:40:59.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.819+0000 7f7c70205640 1 -- 172.21.15.77:0/1091319837 wait complete. 2024-04-25T13:40:59.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 Processor -- start 2024-04-25T13:40:59.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 -- start start 2024-04-25T13:40:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c680a5da0 0x7f7c68072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c6814e9e0 0x7f7c6813df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814f330 0x7f7c6813e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6815c3f0 con 0x7f7c6814e9e0 2024-04-25T13:40:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6815c270 con 0x7f7c680a5da0 2024-04-25T13:40:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6815c570 con 0x7f7c6814f330 2024-04-25T13:40:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6d7a0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c6814e9e0 0x7f7c6813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6d7a0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c6814e9e0 0x7f7c6813df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55114/0 (socket says 172.21.15.77:55114) 2024-04-25T13:40:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6d7a0640 1 -- 172.21.15.77:0/3790263307 learned_addr learned my addr 172.21.15.77:0/3790263307 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6e7a2640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814f330 0x7f7c6813e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6dfa1640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c680a5da0 0x7f7c68072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6d7a0640 1 -- 172.21.15.77:0/3790263307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814f330 msgr2=0x7f7c6813e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6d7a0640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814f330 0x7f7c6813e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6d7a0640 1 -- 172.21.15.77:0/3790263307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c680a5da0 msgr2=0x7f7c68072b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6d7a0640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c680a5da0 0x7f7c68072b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6d7a0640 1 -- 172.21.15.77:0/3790263307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6813ee00 con 0x7f7c6814e9e0 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c6d7a0640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c6814e9e0 0x7f7c6813df30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009870 tx=0x7f7c58019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c5e7fc640 1 -- 172.21.15.77:0/3790263307 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580b2040 con 0x7f7c6814e9e0 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c5e7fc640 1 -- 172.21.15.77:0/3790263307 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c58004230 con 0x7f7c6814e9e0 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c5e7fc640 1 -- 172.21.15.77:0/3790263307 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580ad8f0 con 0x7f7c6814e9e0 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6813e9b0 con 0x7f7c6814e9e0 2024-04-25T13:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.823+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c681434d0 con 0x7f7c6814e9e0 2024-04-25T13:40:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.827+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6806a280 con 0x7f7c6814e9e0 2024-04-25T13:40:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.827+0000 7f7c5e7fc640 1 -- 172.21.15.77:0/3790263307 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f7c580ada90 con 0x7f7c6814e9e0 2024-04-25T13:40:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.827+0000 7f7c5e7fc640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c4c06f3a0 0x7f7c4c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.827+0000 7f7c5e7fc640 1 -- 172.21.15.77:0/3790263307 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7f7c58128c50 con 0x7f7c6814e9e0 2024-04-25T13:40:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.827+0000 7f7c6dfa1640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c4c06f3a0 0x7f7c4c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.827+0000 7f7c6dfa1640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c4c06f3a0 0x7f7c4c0718b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c68070df0 tx=0x7f7c64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:59.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:40:59.831+0000 7f7c5e7fc640 1 -- 172.21.15.77:0/3790263307 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c580ba020 con 0x7f7c6814e9e0 2024-04-25T13:41:00.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.027+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c680c3110 con 0x7f7c6814e9e0 2024-04-25T13:41:00.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.027+0000 7f7c5e7fc640 1 -- 172.21.15.77:0/3790263307 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2216 (secure 0 0 0) 0x7f7c58016150 con 0x7f7c6814e9e0 2024-04-25T13:41:00.029 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:00.029 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2393103049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2393103049},{"type":"v1","addr":"172.21.15.77:6835","nonce":2393103049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6833/1035589958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":1035589958},{"type":"v1","addr":"172.21.15.96:6833","nonce":1035589958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T13:41:00.029 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 3 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c4c06f3a0 msgr2=0x7f7c4c0718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c4c06f3a0 0x7f7c4c0718b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c68070df0 tx=0x7f7c64009040 comp rx=0 tx=0).stop 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c6814e9e0 msgr2=0x7f7c6813df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c6814e9e0 0x7f7c6813df30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009870 tx=0x7f7c58019270 comp rx=0 tx=0).stop 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 shutdown_connections 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c4c06f3a0 0x7f7c4c0718b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c6814f330 0x7f7c6813e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c6814e9e0 0x7f7c6813df30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 --2- 172.21.15.77:0/3790263307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c680a5da0 0x7f7c68072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 >> 172.21.15.77:0/3790263307 conn(0x7f7c680c02a0 msgr2=0x7f7c680c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:00.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 shutdown_connections 2024-04-25T13:41:00.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.031+0000 7f7c70205640 1 -- 172.21.15.77:0/3790263307 wait complete. 2024-04-25T13:41:00.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:00.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb9ea9640 1 Processor -- start 2024-04-25T13:41:00.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb9ea9640 1 -- start start 2024-04-25T13:41:00.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb9ea9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 0x7fedb414fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb9ea9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb40c5ee0 0x7fedb40c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb9ea9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb4071dd0 con 0x7fedb4153730 2024-04-25T13:41:00.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb9ea9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fedb40ab490 con 0x7fedb40c5ee0 2024-04-25T13:41:00.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb9ea9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fedb40ab6e0 con 0x7fedb40a8980 2024-04-25T13:41:00.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedabfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb40c5ee0 0x7fedb40c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fedb4153730 0x7fedb4153b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48870/0 (socket says 172.21.15.77:48870) 2024-04-25T13:41:00.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb3fff640 1 -- 172.21.15.77:0/773458427 learned_addr learned my addr 172.21.15.77:0/773458427 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:00.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedb37fe640 1 --2- 172.21.15.77:0/773458427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 0x7fedb414fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedabfff640 1 -- 172.21.15.77:0/773458427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 msgr2=0x7fedb414fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:00.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedabfff640 1 --2- 172.21.15.77:0/773458427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 0x7fedb414fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedabfff640 1 -- 172.21.15.77:0/773458427 >> v1:172.21.15.77:6789/0 conn(0x7fedb4153730 legacy=0x7fedb4153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.199+0000 7fedabfff640 1 -- 172.21.15.77:0/773458427 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb4150ca0 con 0x7fedb40c5ee0 2024-04-25T13:41:00.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedabfff640 1 --2- 172.21.15.77:0/773458427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40c5ee0 0x7fedb40c62f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0097c0 tx=0x7fed9c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac367005a33c3ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:00.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb2ffd640 1 -- 172.21.15.77:0/773458427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0b0070 con 0x7fedb40c5ee0 2024-04-25T13:41:00.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb2ffd640 1 -- 172.21.15.77:0/773458427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9c0ab600 con 0x7fedb40c5ee0 2024-04-25T13:41:00.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb2ffd640 1 -- 172.21.15.77:0/773458427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0ab9d0 con 0x7fedb40c5ee0 2024-04-25T13:41:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb9ea9640 1 -- 172.21.15.77:0/773458427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40c5ee0 msgr2=0x7fedb40c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb9ea9640 1 --2- 172.21.15.77:0/773458427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40c5ee0 0x7fedb40c62f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0097c0 tx=0x7fed9c01c410 comp rx=0 tx=0).stop 2024-04-25T13:41:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb9ea9640 1 -- 172.21.15.77:0/773458427 shutdown_connections 2024-04-25T13:41:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb9ea9640 1 --2- 172.21.15.77:0/773458427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40c5ee0 0x7fedb40c62f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb9ea9640 1 --2- 172.21.15.77:0/773458427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 0x7fedb414fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb9ea9640 1 -- 172.21.15.77:0/773458427 >> 172.21.15.77:0/773458427 conn(0x7fedb40a7c90 msgr2=0x7fedb40c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb9ea9640 1 -- 172.21.15.77:0/773458427 shutdown_connections 2024-04-25T13:41:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.203+0000 7fedb9ea9640 1 -- 172.21.15.77:0/773458427 wait complete. 2024-04-25T13:41:00.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 Processor -- start 2024-04-25T13:41:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 -- start start 2024-04-25T13:41:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 0x7fedb414a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40c5ee0 0x7fedb4146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb4153730 0x7fedb41ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fedb415d650 con 0x7fedb4153730 2024-04-25T13:41:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fedb415d4d0 con 0x7fedb40c5ee0 2024-04-25T13:41:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fedb415d7d0 con 0x7fedb40a8980 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb4153730 0x7fedb41ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb4153730 0x7fedb41ed5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55144/0 (socket says 172.21.15.77:55144) 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb3fff640 1 -- 172.21.15.77:0/343107712 learned_addr learned my addr 172.21.15.77:0/343107712 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedabfff640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40c5ee0 0x7fedb4146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb37fe640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 0x7fedb414a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb3fff640 1 -- 172.21.15.77:0/343107712 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 msgr2=0x7fedb414a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb3fff640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 0x7fedb414a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb3fff640 1 -- 172.21.15.77:0/343107712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40c5ee0 msgr2=0x7fedb4146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb3fff640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40c5ee0 0x7fedb4146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb3fff640 1 -- 172.21.15.77:0/343107712 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb40abbb0 con 0x7fedb4153730 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb3fff640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb4153730 0x7fedb41ed5d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fedac00cab0 tx=0x7fedac00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb0ff9640 1 -- 172.21.15.77:0/343107712 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac017070 con 0x7fedb4153730 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb0ff9640 1 -- 172.21.15.77:0/343107712 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedac00ac30 con 0x7fedb4153730 2024-04-25T13:41:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb0ff9640 1 -- 172.21.15.77:0/343107712 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac012400 con 0x7fedb4153730 2024-04-25T13:41:00.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb40c2b20 con 0x7fedb4153730 2024-04-25T13:41:00.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.207+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb40c2e00 con 0x7fedb4153730 2024-04-25T13:41:00.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.211+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb406a280 con 0x7fedb4153730 2024-04-25T13:41:00.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.211+0000 7fedb0ff9640 1 -- 172.21.15.77:0/343107712 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7fedac01a070 con 0x7fedb4153730 2024-04-25T13:41:00.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.211+0000 7fedb0ff9640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fed9406f370 0x7fed94071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.211+0000 7fedb37fe640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fed9406f370 0x7fed94071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.211+0000 7fedb0ff9640 1 -- 172.21.15.77:0/343107712 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fedac08ea20 con 0x7fedb4153730 2024-04-25T13:41:00.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.211+0000 7fedb37fe640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fed9406f370 0x7fed94071880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fedb40a8640 tx=0x7feda4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:00.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.215+0000 7fedb0ff9640 1 -- 172.21.15.77:0/343107712 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fedac05b6f0 con 0x7fedb4153730 2024-04-25T13:41:00.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.387+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedb40aae60 con 0x7fedb4153730 2024-04-25T13:41:00.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb0ff9640 1 -- 172.21.15.77:0/343107712 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12849 (secure 0 0 0) 0x7fedac05f9f0 con 0x7fedb4153730 2024-04-25T13:41:00.391 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:00.391 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:00.101024+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:00.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fed9406f370 msgr2=0x7fed94071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fed9406f370 0x7fed94071880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fedb40a8640 tx=0x7feda4008040 comp rx=0 tx=0).stop 2024-04-25T13:41:00.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb4153730 msgr2=0x7fedb41ed5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb4153730 0x7fedb41ed5d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fedac00cab0 tx=0x7fedac00cf70 comp rx=0 tx=0).stop 2024-04-25T13:41:00.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 shutdown_connections 2024-04-25T13:41:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fed9406f370 0x7fed94071880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb4153730 0x7fedb41ed5d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40c5ee0 0x7fedb4146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 --2- 172.21.15.77:0/343107712 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb40a8980 0x7fedb414a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 >> 172.21.15.77:0/343107712 conn(0x7fedb40a7c90 msgr2=0x7fedb40756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 shutdown_connections 2024-04-25T13:41:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.391+0000 7fedb9ea9640 1 -- 172.21.15.77:0/343107712 wait complete. 2024-04-25T13:41:00.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:40:58.420007+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:41:00.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:41:00.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eb021e640 1 Processor -- start 2024-04-25T13:41:00.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eb021e640 1 -- start start 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eb021e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea8074190 0x7f6ea8070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eb021e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ea81521f0 0x7f6ea814be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eb021e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea80b95c0 con 0x7f6ea814c370 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eb021e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6ea814c780 con 0x7f6ea81521f0 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eb021e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea8070850 con 0x7f6ea8074190 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6ead7b9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ea81521f0 0x7f6ea814be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6ead7b9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ea81521f0 0x7f6ea814be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35858/0 (socket says 172.21.15.77:35858) 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eae7bb640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6ea814c370 0x7f6ea8155e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42612/0 (socket says 172.21.15.77:42612) 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6ead7b9640 1 -- 172.21.15.77:0/59869984 learned_addr learned my addr 172.21.15.77:0/59869984 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eadfba640 1 --2- 172.21.15.77:0/59869984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea8074190 0x7f6ea8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6ead7b9640 1 -- 172.21.15.77:0/59869984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea8074190 msgr2=0x7f6ea8070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:00.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6ead7b9640 1 --2- 172.21.15.77:0/59869984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea8074190 0x7f6ea8070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6ead7b9640 1 -- 172.21.15.77:0/59869984 >> v1:172.21.15.77:6789/0 conn(0x7f6ea814c370 legacy=0x7f6ea8155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6eacfb8640 1 -- 172.21.15.77:0/59869984 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744846781 0 0) 0x7f6ea80b95c0 con 0x7f6ea814c370 2024-04-25T13:41:00.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.567+0000 7f6ead7b9640 1 -- 172.21.15.77:0/59869984 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea80745a0 con 0x7f6ea81521f0 2024-04-25T13:41:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6ead7b9640 1 --2- 172.21.15.77:0/59869984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea81521f0 0x7f6ea814be30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009e50 tx=0x7f6ea001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dc8d45b60ec623 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eacfb8640 1 -- 172.21.15.77:0/59869984 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea00a5660 con 0x7f6ea81521f0 2024-04-25T13:41:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eacfb8640 1 -- 172.21.15.77:0/59869984 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea00a5800 con 0x7f6ea81521f0 2024-04-25T13:41:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eacfb8640 1 -- 172.21.15.77:0/59869984 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea00a5bd0 con 0x7f6ea81521f0 2024-04-25T13:41:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 -- 172.21.15.77:0/59869984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea81521f0 msgr2=0x7f6ea814be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 --2- 172.21.15.77:0/59869984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea81521f0 0x7f6ea814be30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009e50 tx=0x7f6ea001c9a0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 -- 172.21.15.77:0/59869984 shutdown_connections 2024-04-25T13:41:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 --2- 172.21.15.77:0/59869984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea81521f0 0x7f6ea814be30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 --2- 172.21.15.77:0/59869984 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea8074190 0x7f6ea8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 -- 172.21.15.77:0/59869984 >> 172.21.15.77:0/59869984 conn(0x7f6ea806f560 msgr2=0x7f6ea806f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:00.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 -- 172.21.15.77:0/59869984 shutdown_connections 2024-04-25T13:41:00.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 -- 172.21.15.77:0/59869984 wait complete. 2024-04-25T13:41:00.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 Processor -- start 2024-04-25T13:41:00.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.571+0000 7f6eb021e640 1 -- start start 2024-04-25T13:41:00.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eb021e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8074190 0x7f6ea80c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eb021e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea814c370 0x7f6ea8146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eb021e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ea81521f0 0x7f6ea813b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eb021e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea815f770 con 0x7f6ea8074190 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eb021e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea815f5f0 con 0x7f6ea81521f0 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eb021e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea815f8f0 con 0x7f6ea814c370 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eadfba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8074190 0x7f6ea80c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eadfba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8074190 0x7f6ea80c2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35872/0 (socket says 172.21.15.77:35872) 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eadfba640 1 -- 172.21.15.77:0/2231065528 learned_addr learned my addr 172.21.15.77:0/2231065528 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6ead7b9640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea814c370 0x7f6ea8146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eae7bb640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ea81521f0 0x7f6ea813b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eadfba640 1 -- 172.21.15.77:0/2231065528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea814c370 msgr2=0x7f6ea8146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eadfba640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea814c370 0x7f6ea8146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eadfba640 1 -- 172.21.15.77:0/2231065528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ea81521f0 msgr2=0x7f6ea813b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eadfba640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ea81521f0 0x7f6ea813b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eadfba640 1 -- 172.21.15.77:0/2231065528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea81efce0 con 0x7f6ea8074190 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6ead7b9640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea814c370 0x7f6ea8146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eadfba640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8074190 0x7f6ea80c2dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400d5f0 tx=0x7f6ea400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6e9e7fc640 1 -- 172.21.15.77:0/2231065528 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4004240 con 0x7f6ea8074190 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6e9e7fc640 1 -- 172.21.15.77:0/2231065528 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea40043e0 con 0x7f6ea8074190 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea813eaf0 con 0x7f6ea8074190 2024-04-25T13:41:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6e9e7fc640 1 -- 172.21.15.77:0/2231065528 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4003840 con 0x7f6ea8074190 2024-04-25T13:41:00.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea80c3310 con 0x7f6ea8074190 2024-04-25T13:41:00.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea806a1a0 con 0x7f6ea8074190 2024-04-25T13:41:00.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6e9e7fc640 1 -- 172.21.15.77:0/2231065528 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f6ea40039e0 con 0x7f6ea8074190 2024-04-25T13:41:00.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6e9e7fc640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6e8c06f3a0 0x7f6e8c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6e9e7fc640 1 -- 172.21.15.77:0/2231065528 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6ea408fc50 con 0x7f6ea8074190 2024-04-25T13:41:00.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.575+0000 7f6ead7b9640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6e8c06f3a0 0x7f6e8c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.579+0000 7f6ead7b9640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6e8c06f3a0 0x7f6e8c0718b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00ae000 tx=0x7f6ea00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:00.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.583+0000 7f6e9e7fc640 1 -- 172.21.15.77:0/2231065528 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6ea405cf50 con 0x7f6ea8074190 2024-04-25T13:41:00.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.739+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6ea814b9a0 con 0x7f6ea8074190 2024-04-25T13:41:00.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6e9e7fc640 1 -- 172.21.15.77:0/2231065528 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f6ea405c850 con 0x7f6ea8074190 2024-04-25T13:41:00.743 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T13:41:00.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6e8c06f3a0 msgr2=0x7f6e8c0718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6e8c06f3a0 0x7f6e8c0718b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00ae000 tx=0x7f6ea00a7070 comp rx=0 tx=0).stop 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8074190 msgr2=0x7f6ea80c2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8074190 0x7f6ea80c2dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400d5f0 tx=0x7f6ea400dab0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 shutdown_connections 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6e8c06f3a0 0x7f6e8c0718b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ea81521f0 0x7f6ea813b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6ea814c370 0x7f6ea8146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 --2- 172.21.15.77:0/2231065528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8074190 0x7f6ea80c2dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 >> 172.21.15.77:0/2231065528 conn(0x7f6ea806f560 msgr2=0x7f6ea80bfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 shutdown_connections 2024-04-25T13:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.743+0000 7f6eb021e640 1 -- 172.21.15.77:0/2231065528 wait complete. 2024-04-25T13:41:00.762 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T13:41:00.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.907+0000 7fcd89749640 1 Processor -- start 2024-04-25T13:41:00.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.907+0000 7fcd89749640 1 -- start start 2024-04-25T13:41:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd89749640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd841520a0 0x7fcd840ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd89749640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcd840c7180 0x7fcd840c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd89749640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd840c6960 con 0x7fcd840ac6b0 2024-04-25T13:41:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd89749640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcd84153080 con 0x7fcd841520a0 2024-04-25T13:41:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd89749640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fcd84153340 con 0x7fcd840c7180 2024-04-25T13:41:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd827fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd841520a0 0x7fcd840ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd827fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd841520a0 0x7fcd840ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35888/0 (socket says 172.21.15.77:35888) 2024-04-25T13:41:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd827fc640 1 -- 172.21.15.77:0/2247412980 learned_addr learned my addr 172.21.15.77:0/2247412980 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd837fe640 1 --2- 172.21.15.77:0/2247412980 >> v2:172.21.15.96:3300/0 conn(0x7fcd840c7180 0x7fcd840c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd827fc640 1 -- 172.21.15.77:0/2247412980 >> v2:172.21.15.96:3300/0 conn(0x7fcd840c7180 msgr2=0x7fcd840c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd827fc640 1 --2- 172.21.15.77:0/2247412980 >> v2:172.21.15.96:3300/0 conn(0x7fcd840c7180 0x7fcd840c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd827fc640 1 -- 172.21.15.77:0/2247412980 >> v1:172.21.15.96:6789/0 conn(0x7fcd840ac6b0 legacy=0x7fcd84151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd827fc640 1 -- 172.21.15.77:0/2247412980 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd840c7ad0 con 0x7fcd841520a0 2024-04-25T13:41:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd827fc640 1 --2- 172.21.15.77:0/2247412980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 0x7fcd840ab4a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd840c5430 tx=0x7fcd7401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97d2b1e6b4281e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd81ffb640 1 -- 172.21.15.77:0/2247412980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd740b1070 con 0x7fcd841520a0 2024-04-25T13:41:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd81ffb640 1 -- 172.21.15.77:0/2247412980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd740ac440 con 0x7fcd841520a0 2024-04-25T13:41:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.911+0000 7fcd81ffb640 1 -- 172.21.15.77:0/2247412980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd740ac810 con 0x7fcd841520a0 2024-04-25T13:41:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 -- 172.21.15.77:0/2247412980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 msgr2=0x7fcd840ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 --2- 172.21.15.77:0/2247412980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 0x7fcd840ab4a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd840c5430 tx=0x7fcd7401c400 comp rx=0 tx=0).stop 2024-04-25T13:41:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 -- 172.21.15.77:0/2247412980 shutdown_connections 2024-04-25T13:41:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 --2- 172.21.15.77:0/2247412980 >> v2:172.21.15.96:3300/0 conn(0x7fcd840c7180 0x7fcd840c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 --2- 172.21.15.77:0/2247412980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 0x7fcd840ab4a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 -- 172.21.15.77:0/2247412980 >> 172.21.15.77:0/2247412980 conn(0x7fcd8406daf0 msgr2=0x7fcd8406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 -- 172.21.15.77:0/2247412980 shutdown_connections 2024-04-25T13:41:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 -- 172.21.15.77:0/2247412980 wait complete. 2024-04-25T13:41:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 Processor -- start 2024-04-25T13:41:00.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.915+0000 7fcd89749640 1 -- start start 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd89749640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd840ac6b0 0x7fcd84151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd89749640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd840c7180 0x7fcd840bf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd89749640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 0x7fcd841eb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd89749640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8415f930 con 0x7fcd841520a0 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd89749640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8415f7b0 con 0x7fcd840ac6b0 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd89749640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8415fab0 con 0x7fcd840c7180 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd837fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 0x7fcd841eb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd837fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 0x7fcd841eb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35896/0 (socket says 172.21.15.77:35896) 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd82ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd840ac6b0 0x7fcd84151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd837fe640 1 -- 172.21.15.77:0/1125538996 learned_addr learned my addr 172.21.15.77:0/1125538996 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:00.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd827fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd840c7180 0x7fcd840bf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd837fe640 1 -- 172.21.15.77:0/1125538996 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd840c7180 msgr2=0x7fcd840bf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd837fe640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd840c7180 0x7fcd840bf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd837fe640 1 -- 172.21.15.77:0/1125538996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd840ac6b0 msgr2=0x7fcd84151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd837fe640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd840ac6b0 0x7fcd84151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd837fe640 1 -- 172.21.15.77:0/1125538996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd840c1990 con 0x7fcd841520a0 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd837fe640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 0x7fcd841eb4f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009cb0 tx=0x7fcd7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd6b7fe640 1 -- 172.21.15.77:0/1125538996 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c018020 con 0x7fcd841520a0 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd6b7fe640 1 -- 172.21.15.77:0/1125538996 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c014480 con 0x7fcd841520a0 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd841ef6e0 con 0x7fcd841520a0 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd6b7fe640 1 -- 172.21.15.77:0/1125538996 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c014870 con 0x7fcd841520a0 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd841ec260 con 0x7fcd841520a0 2024-04-25T13:41:00.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd8406a280 con 0x7fcd841520a0 2024-04-25T13:41:00.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.919+0000 7fcd6b7fe640 1 -- 172.21.15.77:0/1125538996 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7fcd7c01b020 con 0x7fcd841520a0 2024-04-25T13:41:00.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.923+0000 7fcd6b7fe640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd7006f370 0x7fcd70071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:00.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.923+0000 7fcd82ffd640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd7006f370 0x7fcd70071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:00.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.923+0000 7fcd6b7fe640 1 -- 172.21.15.77:0/1125538996 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fcd7c0900e0 con 0x7fcd841520a0 2024-04-25T13:41:00.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.923+0000 7fcd82ffd640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd7006f370 0x7fcd70071880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcd78007fd0 tx=0x7fcd78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:00.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:00.927+0000 7fcd6b7fe640 1 -- 172.21.15.77:0/1125538996 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd7c022020 con 0x7fcd841520a0 2024-04-25T13:41:01.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.087+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcd841553b0 con 0x7fcd841520a0 2024-04-25T13:41:01.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.087+0000 7fcd6b7fe640 1 -- 172.21.15.77:0/1125538996 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fcd7c010040 con 0x7fcd841520a0 2024-04-25T13:41:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:01.091 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2024-04-25T13:41:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-25T13:41:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2024-04-25T13:41:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2024-04-25T13:41:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T13:41:01.091 INFO:teuthology.orchestra.run.smithi077.stdout:] 2024-04-25T13:41:01.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd7006f370 msgr2=0x7fcd70071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:01.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd7006f370 0x7fcd70071880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcd78007fd0 tx=0x7fcd78009040 comp rx=0 tx=0).stop 2024-04-25T13:41:01.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 msgr2=0x7fcd841eb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:01.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 0x7fcd841eb4f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009cb0 tx=0x7fcd7c00c490 comp rx=0 tx=0).stop 2024-04-25T13:41:01.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 shutdown_connections 2024-04-25T13:41:01.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd7006f370 0x7fcd70071880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd841520a0 0x7fcd841eb4f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd840c7180 0x7fcd840bf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 --2- 172.21.15.77:0/1125538996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd840ac6b0 0x7fcd84151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 >> 172.21.15.77:0/1125538996 conn(0x7fcd8406daf0 msgr2=0x7fcd84153ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:01.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 shutdown_connections 2024-04-25T13:41:01.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.091+0000 7fcd89749640 1 -- 172.21.15.77:0/1125538996 wait complete. 2024-04-25T13:41:01.112 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T13:41:01.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T13:41:01.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.263+0000 7fe8ac6fc640 1 Processor -- start 2024-04-25T13:41:01.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.263+0000 7fe8ac6fc640 1 -- start start 2024-04-25T13:41:01.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8ac6fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe8a40747b0 0x7fe8a40c1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:01.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8ac6fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8a4153e90 0x7fe8a41542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:01.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8ac6fc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a40707f0 con 0x7fe8a406c5b0 2024-04-25T13:41:01.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8ac6fc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a4153970 con 0x7fe8a4153e90 2024-04-25T13:41:01.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8ac6fc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a4150830 con 0x7fe8a40747b0 2024-04-25T13:41:01.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8a9c97640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8a4153e90 0x7fe8a41542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:01.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8aac99640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe8a406c5b0 0x7fe8a406c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42616/0 (socket says 172.21.15.77:42616) 2024-04-25T13:41:01.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8aac99640 1 -- 172.21.15.77:0/3638479352 learned_addr learned my addr 172.21.15.77:0/3638479352 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:01.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8aa498640 1 --2- 172.21.15.77:0/3638479352 >> v2:172.21.15.96:3300/0 conn(0x7fe8a40747b0 0x7fe8a40c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:01.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8a9c97640 1 -- 172.21.15.77:0/3638479352 >> v2:172.21.15.96:3300/0 conn(0x7fe8a40747b0 msgr2=0x7fe8a40c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:01.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8a9c97640 1 --2- 172.21.15.77:0/3638479352 >> v2:172.21.15.96:3300/0 conn(0x7fe8a40747b0 0x7fe8a40c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8a9c97640 1 -- 172.21.15.77:0/3638479352 >> v1:172.21.15.77:6789/0 conn(0x7fe8a406c5b0 legacy=0x7fe8a406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:01.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8a9496640 1 -- 172.21.15.77:0/3638479352 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875233143 0 0) 0x7fe8a40707f0 con 0x7fe8a406c5b0 2024-04-25T13:41:01.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8a9c97640 1 -- 172.21.15.77:0/3638479352 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a40c1b90 con 0x7fe8a4153e90 2024-04-25T13:41:01.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8aa498640 1 --2- 172.21.15.77:0/3638479352 >> v2:172.21.15.96:3300/0 conn(0x7fe8a40747b0 0x7fe8a40c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:01.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.267+0000 7fe8a9c97640 1 --2- 172.21.15.77:0/3638479352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a4153e90 0x7fe8a41542a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40a9c90 tx=0x7fe89401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb194ed688cf417 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:01.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8a9496640 1 -- 172.21.15.77:0/3638479352 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8940b0070 con 0x7fe8a4153e90 2024-04-25T13:41:01.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8a9496640 1 -- 172.21.15.77:0/3638479352 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8940ab600 con 0x7fe8a4153e90 2024-04-25T13:41:01.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8a9496640 1 -- 172.21.15.77:0/3638479352 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8940ab9d0 con 0x7fe8a4153e90 2024-04-25T13:41:01.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3638479352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a4153e90 msgr2=0x7fe8a41542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:01.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 --2- 172.21.15.77:0/3638479352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a4153e90 0x7fe8a41542a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40a9c90 tx=0x7fe89401c3f0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3638479352 shutdown_connections 2024-04-25T13:41:01.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 --2- 172.21.15.77:0/3638479352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a4153e90 0x7fe8a41542a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 --2- 172.21.15.77:0/3638479352 >> v2:172.21.15.96:3300/0 conn(0x7fe8a40747b0 0x7fe8a40c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3638479352 >> 172.21.15.77:0/3638479352 conn(0x7fe8a40a6900 msgr2=0x7fe8a40a6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:01.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3638479352 shutdown_connections 2024-04-25T13:41:01.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3638479352 wait complete. 2024-04-25T13:41:01.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 Processor -- start 2024-04-25T13:41:01.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 -- start start 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a406c5b0 0x7fe8a41468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a40747b0 0x7fe8a4152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8a4153e90 0x7fe8a41ea860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a415d6d0 con 0x7fe8a40747b0 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a415d550 con 0x7fe8a406c5b0 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.271+0000 7fe8ac6fc640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a415d850 con 0x7fe8a4153e90 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8a9c97640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a40747b0 0x7fe8a4152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8a9c97640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a40747b0 0x7fe8a4152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35908/0 (socket says 172.21.15.77:35908) 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8a9c97640 1 -- 172.21.15.77:0/3867875211 learned_addr learned my addr 172.21.15.77:0/3867875211 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8aa498640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a406c5b0 0x7fe8a41468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8aac99640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8a4153e90 0x7fe8a41ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:01.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8a9c97640 1 -- 172.21.15.77:0/3867875211 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8a4153e90 msgr2=0x7fe8a41ea860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8a9c97640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8a4153e90 0x7fe8a41ea860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8a9c97640 1 -- 172.21.15.77:0/3867875211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a406c5b0 msgr2=0x7fe8a41468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8a9c97640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a406c5b0 0x7fe8a41468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8a9c97640 1 -- 172.21.15.77:0/3867875211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a41ebf30 con 0x7fe8a40747b0 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8aac99640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8a4153e90 0x7fe8a41ea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8a9c97640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a40747b0 0x7fe8a4152d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe8940ae040 tx=0x7fe89401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe89affd640 1 -- 172.21.15.77:0/3867875211 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8940bc070 con 0x7fe8a40747b0 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe89affd640 1 -- 172.21.15.77:0/3867875211 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8940b1040 con 0x7fe8a40747b0 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe89affd640 1 -- 172.21.15.77:0/3867875211 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8940b0050 con 0x7fe8a40747b0 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a41ec170 con 0x7fe8a40747b0 2024-04-25T13:41:01.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a4152860 con 0x7fe8a40747b0 2024-04-25T13:41:01.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a406a2f0 con 0x7fe8a40747b0 2024-04-25T13:41:01.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe89affd640 1 -- 172.21.15.77:0/3867875211 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7fe894003620 con 0x7fe8a40747b0 2024-04-25T13:41:01.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe89affd640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe88806f3a0 0x7fe8880718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:01.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe89affd640 1 -- 172.21.15.77:0/3867875211 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe894128b60 con 0x7fe8a40747b0 2024-04-25T13:41:01.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8aa498640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe88806f3a0 0x7fe8880718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:01.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.275+0000 7fe8aa498640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe88806f3a0 0x7fe8880718b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0006fd0 tx=0x7fe8a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:01.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.283+0000 7fe89affd640 1 -- 172.21.15.77:0/3867875211 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe894016070 con 0x7fe8a40747b0 2024-04-25T13:41:01.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.371+0000 7fe89affd640 1 -- 172.21.15.77:0/3867875211 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe8940f1a10 con 0x7fe8a40747b0 2024-04-25T13:41:01.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:01.447+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe8a41ebd40 con 0x7fe8a40747b0 2024-04-25T13:41:02.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.363+0000 7fe89affd640 1 -- 172.21.15.77:0/3867875211 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fe8940f5e80 con 0x7fe8a40747b0 2024-04-25T13:41:02.365 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2024-04-25T13:41:02.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe88806f3a0 msgr2=0x7fe8880718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:02.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe88806f3a0 0x7fe8880718b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0006fd0 tx=0x7fe8a0008040 comp rx=0 tx=0).stop 2024-04-25T13:41:02.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a40747b0 msgr2=0x7fe8a4152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:02.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a40747b0 0x7fe8a4152d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe8940ae040 tx=0x7fe89401ac30 comp rx=0 tx=0).stop 2024-04-25T13:41:02.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 shutdown_connections 2024-04-25T13:41:02.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe88806f3a0 0x7fe8880718b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8a4153e90 0x7fe8a41ea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a40747b0 0x7fe8a4152d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 --2- 172.21.15.77:0/3867875211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8a406c5b0 0x7fe8a41468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 >> 172.21.15.77:0/3867875211 conn(0x7fe8a40a6900 msgr2=0x7fe8a414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:02.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 shutdown_connections 2024-04-25T13:41:02.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.367+0000 7fe8ac6fc640 1 -- 172.21.15.77:0/3867875211 wait complete. 2024-04-25T13:41:02.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T13:41:02.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.555+0000 7f4d9015d640 1 Processor -- start 2024-04-25T13:41:02.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.555+0000 7f4d9015d640 1 -- start start 2024-04-25T13:41:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.555+0000 7f4d9015d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4d880a81b0 0x7f4d880c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.555+0000 7f4d9015d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d8814e680 0x7f4d8814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.555+0000 7f4d9015d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d880728e0 con 0x7f4d88071950 2024-04-25T13:41:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.555+0000 7f4d9015d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4d88072bc0 con 0x7f4d880a81b0 2024-04-25T13:41:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.555+0000 7f4d9015d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f4d880a4da0 con 0x7f4d8814e680 2024-04-25T13:41:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8def9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4d880a81b0 0x7f4d880c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8e6fa640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4d88071950 0x7f4d88071d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42632/0 (socket says 172.21.15.77:42632) 2024-04-25T13:41:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8e6fa640 1 -- 172.21.15.77:0/2588183803 learned_addr learned my addr 172.21.15.77:0/2588183803 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:02.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8d6f8640 1 --2- 172.21.15.77:0/2588183803 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d8814e680 0x7f4d8814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:02.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8def9640 1 -- 172.21.15.77:0/2588183803 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d8814e680 msgr2=0x7f4d8814ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:02.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8def9640 1 --2- 172.21.15.77:0/2588183803 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d8814e680 0x7f4d8814ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8def9640 1 -- 172.21.15.77:0/2588183803 >> v1:172.21.15.77:6789/0 conn(0x7f4d88071950 legacy=0x7f4d88071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:02.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8def9640 1 -- 172.21.15.77:0/2588183803 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d880c4460 con 0x7f4d880a81b0 2024-04-25T13:41:02.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8cef7640 1 -- 172.21.15.77:0/2588183803 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115477981 0 0) 0x7f4d880728e0 con 0x7f4d88071950 2024-04-25T13:41:02.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8def9640 1 --2- 172.21.15.77:0/2588183803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d880a81b0 0x7f4d880c3f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d780097c0 tx=0x7f4d7801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8ea615743abc5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:02.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8cef7640 1 -- 172.21.15.77:0/2588183803 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d780b1070 con 0x7f4d880a81b0 2024-04-25T13:41:02.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8cef7640 1 -- 172.21.15.77:0/2588183803 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d780ac410 con 0x7f4d880a81b0 2024-04-25T13:41:02.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d8cef7640 1 -- 172.21.15.77:0/2588183803 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d780ac7e0 con 0x7f4d880a81b0 2024-04-25T13:41:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d9015d640 1 -- 172.21.15.77:0/2588183803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d880a81b0 msgr2=0x7f4d880c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d9015d640 1 --2- 172.21.15.77:0/2588183803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d880a81b0 0x7f4d880c3f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d780097c0 tx=0x7f4d7801c4a0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d9015d640 1 -- 172.21.15.77:0/2588183803 shutdown_connections 2024-04-25T13:41:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d9015d640 1 --2- 172.21.15.77:0/2588183803 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d8814e680 0x7f4d8814ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d9015d640 1 --2- 172.21.15.77:0/2588183803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d880a81b0 0x7f4d880c3f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d9015d640 1 -- 172.21.15.77:0/2588183803 >> 172.21.15.77:0/2588183803 conn(0x7f4d880a59f0 msgr2=0x7f4d880c3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d9015d640 1 -- 172.21.15.77:0/2588183803 shutdown_connections 2024-04-25T13:41:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.559+0000 7f4d9015d640 1 -- 172.21.15.77:0/2588183803 wait complete. 2024-04-25T13:41:02.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 Processor -- start 2024-04-25T13:41:02.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 -- start start 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d88071950 0x7f4d88144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d880a81b0 0x7f4d8813dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d8814e680 0x7f4d8813e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8806eb00 con 0x7f4d8814e680 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8806e980 con 0x7f4d880a81b0 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8806ec80 con 0x7f4d88071950 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8e6fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d8814e680 0x7f4d8813e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8e6fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d8814e680 0x7f4d8813e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35934/0 (socket says 172.21.15.77:35934) 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8e6fa640 1 -- 172.21.15.77:0/3886361684 learned_addr learned my addr 172.21.15.77:0/3886361684 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8def9640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d88071950 0x7f4d88144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8d6f8640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d880a81b0 0x7f4d8813dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8e6fa640 1 -- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d88071950 msgr2=0x7f4d88144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8e6fa640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d88071950 0x7f4d88144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8e6fa640 1 -- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d880a81b0 msgr2=0x7f4d8813dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8e6fa640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d880a81b0 0x7f4d8813dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8e6fa640 1 -- 172.21.15.77:0/3886361684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d88149ac0 con 0x7f4d8814e680 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8d6f8640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d880a81b0 0x7f4d8813dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8def9640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d88071950 0x7f4d88144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d8e6fa640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d8814e680 0x7f4d8813e000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000c6d0 tx=0x7f4d8000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d7e7fc640 1 -- 172.21.15.77:0/3886361684 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80018070 con 0x7f4d8814e680 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d7e7fc640 1 -- 172.21.15.77:0/3886361684 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d80004d70 con 0x7f4d8814e680 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d881ea570 con 0x7f4d8814e680 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d7e7fc640 1 -- 172.21.15.77:0/3886361684 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000a880 con 0x7f4d8814e680 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.563+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d881497e0 con 0x7f4d8814e680 2024-04-25T13:41:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.567+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d881471d0 con 0x7f4d8814e680 2024-04-25T13:41:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.567+0000 7f4d7e7fc640 1 -- 172.21.15.77:0/3886361684 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4d8001b070 con 0x7f4d8814e680 2024-04-25T13:41:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.567+0000 7f4d7e7fc640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4d6c06f400 0x7f4d6c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.567+0000 7f4d7e7fc640 1 -- 172.21.15.77:0/3886361684 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f4d8008eab0 con 0x7f4d8814e680 2024-04-25T13:41:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.567+0000 7f4d8def9640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4d6c06f400 0x7f4d6c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.567+0000 7f4d8def9640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4d6c06f400 0x7f4d6c071910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d780ae000 tx=0x7f4d78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:02.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.571+0000 7f4d7e7fc640 1 -- 172.21.15.77:0/3886361684 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d8005bcf0 con 0x7f4d8814e680 2024-04-25T13:41:02.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:02.731+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4d8806a210 con 0x7f4d8814e680 2024-04-25T13:41:03.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.379+0000 7f4d7e7fc640 1 -- 172.21.15.77:0/3886361684 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f4d8005b5f0 con 0x7f4d8814e680 2024-04-25T13:41:03.380 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2024-04-25T13:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4d6c06f400 msgr2=0x7f4d6c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4d6c06f400 0x7f4d6c071910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d780ae000 tx=0x7f4d78008040 comp rx=0 tx=0).stop 2024-04-25T13:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d8814e680 msgr2=0x7f4d8813e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d8814e680 0x7f4d8813e000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000c6d0 tx=0x7f4d8000cb90 comp rx=0 tx=0).stop 2024-04-25T13:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 shutdown_connections 2024-04-25T13:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4d6c06f400 0x7f4d6c071910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d8814e680 0x7f4d8813e000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d880a81b0 0x7f4d8813dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 --2- 172.21.15.77:0/3886361684 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4d88071950 0x7f4d88144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 >> 172.21.15.77:0/3886361684 conn(0x7f4d880a59f0 msgr2=0x7f4d88073cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 shutdown_connections 2024-04-25T13:41:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.383+0000 7f4d9015d640 1 -- 172.21.15.77:0/3886361684 wait complete. 2024-04-25T13:41:03.423 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T13:41:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f465a140640 1 Processor -- start 2024-04-25T13:41:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f465a140640 1 -- start start 2024-04-25T13:41:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f465a140640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f465414e710 0x7f465414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f465a140640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414f060 0x7f465414f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f465a140640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46541535c0 con 0x7f46540a5580 2024-04-25T13:41:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f465a140640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f46540a3760 con 0x7f465414e710 2024-04-25T13:41:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f465a140640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f4654153090 con 0x7f465414f060 2024-04-25T13:41:03.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f4652ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f465414e710 0x7f465414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:03.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f4653fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414f060 0x7f465414f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:03.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f46537fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f46540a5580 0x7f465406f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.77:55802/0 (socket says 172.21.15.77:55802) 2024-04-25T13:41:03.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f46537fe640 1 -- 172.21.15.77:0/2693002266 learned_addr learned my addr 172.21.15.77:0/2693002266 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:03.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f4653fff640 1 -- 172.21.15.77:0/2693002266 >> v2:172.21.15.96:3300/0 conn(0x7f465414e710 msgr2=0x7f465414eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:03.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f4653fff640 1 --2- 172.21.15.77:0/2693002266 >> v2:172.21.15.96:3300/0 conn(0x7f465414e710 0x7f465414eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:03.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f4653fff640 1 -- 172.21.15.77:0/2693002266 >> v1:172.21.15.96:6789/0 conn(0x7f46540a5580 legacy=0x7f465406f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:03.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f4653fff640 1 -- 172.21.15.77:0/2693002266 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46540a5990 con 0x7f465414f060 2024-04-25T13:41:03.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.583+0000 7f4652ffd640 1 --2- 172.21.15.77:0/2693002266 >> v2:172.21.15.96:3300/0 conn(0x7f465414e710 0x7f465414eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:03.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f4653fff640 1 --2- 172.21.15.77:0/2693002266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414f060 0x7f465414f470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f464c009d90 tx=0x7f464c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6050d6c7357d2e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:03.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f46527fc640 1 -- 172.21.15.77:0/2693002266 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c0b2070 con 0x7f465414f060 2024-04-25T13:41:03.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f46527fc640 1 -- 172.21.15.77:0/2693002266 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f464c0a5a00 con 0x7f465414f060 2024-04-25T13:41:03.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f46527fc640 1 -- 172.21.15.77:0/2693002266 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c0a5dd0 con 0x7f465414f060 2024-04-25T13:41:03.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f465a140640 1 -- 172.21.15.77:0/2693002266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414f060 msgr2=0x7f465414f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:03.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f465a140640 1 --2- 172.21.15.77:0/2693002266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414f060 0x7f465414f470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f464c009d90 tx=0x7f464c01c940 comp rx=0 tx=0).stop 2024-04-25T13:41:03.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f465a140640 1 -- 172.21.15.77:0/2693002266 shutdown_connections 2024-04-25T13:41:03.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f465a140640 1 --2- 172.21.15.77:0/2693002266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414f060 0x7f465414f470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:03.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f465a140640 1 --2- 172.21.15.77:0/2693002266 >> v2:172.21.15.96:3300/0 conn(0x7f465414e710 0x7f465414eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:03.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f465a140640 1 -- 172.21.15.77:0/2693002266 >> 172.21.15.77:0/2693002266 conn(0x7f46540c3cd0 msgr2=0x7f46540c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:03.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f465a140640 1 -- 172.21.15.77:0/2693002266 shutdown_connections 2024-04-25T13:41:03.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.587+0000 7f465a140640 1 -- 172.21.15.77:0/2693002266 wait complete. 2024-04-25T13:41:03.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 Processor -- start 2024-04-25T13:41:03.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 -- start start 2024-04-25T13:41:03.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540a5580 0x7f4654147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:03.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414e710 0x7f465414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:03.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f060 0x7f465414be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:03.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f465415c210 con 0x7f465414f060 2024-04-25T13:41:03.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4654070170 con 0x7f46540a5580 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f465415c390 con 0x7f465414e710 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4653fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f060 0x7f465414be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4653fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f060 0x7f465414be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35950/0 (socket says 172.21.15.77:35950) 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4653fff640 1 -- 172.21.15.77:0/2779724451 learned_addr learned my addr 172.21.15.77:0/2779724451 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4652ffd640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414e710 0x7f465414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f46537fe640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540a5580 0x7f4654147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4653fff640 1 -- 172.21.15.77:0/2779724451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414e710 msgr2=0x7f465414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4653fff640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414e710 0x7f465414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4653fff640 1 -- 172.21.15.77:0/2779724451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540a5580 msgr2=0x7f4654147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4653fff640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540a5580 0x7f4654147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4653fff640 1 -- 172.21.15.77:0/2779724451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46541461f0 con 0x7f465414f060 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4652ffd640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414e710 0x7f465414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:03.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f4653fff640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f060 0x7f465414be30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f464c0b0040 tx=0x7f464c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:03.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f463bfff640 1 -- 172.21.15.77:0/2779724451 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c0b2050 con 0x7f465414f060 2024-04-25T13:41:03.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f463bfff640 1 -- 172.21.15.77:0/2779724451 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f464c0be070 con 0x7f465414f060 2024-04-25T13:41:03.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f463bfff640 1 -- 172.21.15.77:0/2779724451 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c0ada90 con 0x7f465414f060 2024-04-25T13:41:03.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46541ef980 con 0x7f465414f060 2024-04-25T13:41:03.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465414b5a0 con 0x7f465414f060 2024-04-25T13:41:03.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.591+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46541493b0 con 0x7f465414f060 2024-04-25T13:41:03.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.595+0000 7f463bfff640 1 -- 172.21.15.77:0/2779724451 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f464c0adc30 con 0x7f465414f060 2024-04-25T13:41:03.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.595+0000 7f463bfff640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f464006f400 0x7f4640071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:03.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.595+0000 7f46537fe640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f464006f400 0x7f4640071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:03.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.595+0000 7f463bfff640 1 -- 172.21.15.77:0/2779724451 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f464c12b0e0 con 0x7f465414f060 2024-04-25T13:41:03.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.595+0000 7f46537fe640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f464006f400 0x7f4640071910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4644000f70 tx=0x7f4644009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:03.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.599+0000 7f463bfff640 1 -- 172.21.15.77:0/2779724451 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f464c016560 con 0x7f465414f060 2024-04-25T13:41:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:03.795+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f465406a1a0 con 0x7f465414f060 2024-04-25T13:41:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.379+0000 7f463bfff640 1 -- 172.21.15.77:0/2779724451 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f464c0f81e0 con 0x7f465414f060 2024-04-25T13:41:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T13:41:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f464006f400 msgr2=0x7f4640071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f464006f400 0x7f4640071910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4644000f70 tx=0x7f4644009040 comp rx=0 tx=0).stop 2024-04-25T13:41:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f060 msgr2=0x7f465414be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f060 0x7f465414be30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f464c0b0040 tx=0x7f464c0196e0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 shutdown_connections 2024-04-25T13:41:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f464006f400 0x7f4640071910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f060 0x7f465414be30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f465414e710 0x7f465414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 --2- 172.21.15.77:0/2779724451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46540a5580 0x7f4654147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.387+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 >> 172.21.15.77:0/2779724451 conn(0x7f46540c3cd0 msgr2=0x7f46540a4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:04.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.391+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 shutdown_connections 2024-04-25T13:41:04.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.391+0000 7f465a140640 1 -- 172.21.15.77:0/2779724451 wait complete. 2024-04-25T13:41:04.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:04.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f502b13d640 1 Processor -- start 2024-04-25T13:41:04.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f502b13d640 1 -- start start 2024-04-25T13:41:04.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f502b13d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50240b85f0 0x7f5024146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f502b13d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5024073bc0 0x7f5024073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f502b13d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5024074510 con 0x7f5024071900 2024-04-25T13:41:04.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f502b13d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f5024071d10 con 0x7f5024073bc0 2024-04-25T13:41:04.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f502b13d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f5024150ff0 con 0x7f50240b85f0 2024-04-25T13:41:04.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5023fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5024071900 0x7f502406f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42634/0 (socket says 172.21.15.77:42634) 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5023fff640 1 -- 172.21.15.77:0/1795030779 learned_addr learned my addr 172.21.15.77:0/1795030779 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5028ed9640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50240b85f0 0x7f5024146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50296da640 1 --2- 172.21.15.77:0/1795030779 >> v2:172.21.15.96:3300/0 conn(0x7f5024073bc0 0x7f5024073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191683655 0 0) 0x7f5024074510 con 0x7f5024071900 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f500c003530 con 0x7f5024071900 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1706073532 0 0) 0x7f500c003530 con 0x7f5024071900 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50240b85f0 msgr2=0x7f5024146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50240b85f0 0x7f5024146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 >> v2:172.21.15.96:3300/0 conn(0x7f5024073bc0 msgr2=0x7f5024073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 --2- 172.21.15.77:0/1795030779 >> v2:172.21.15.96:3300/0 conn(0x7f5024073bc0 0x7f5024073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50240733c0 con 0x7f5024071900 2024-04-25T13:41:04.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f5018001680 con 0x7f5024071900 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 >> v1:172.21.15.77:6789/0 conn(0x7f5024071900 legacy=0x7f502406f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500c0039c0 0x7f500c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50240b85f0 0x7f500c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f500c004d50 0x7f500c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5024071d10 con 0x7f500c0039c0 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5024150ff0 con 0x7f500c004d50 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f500c00ba50 con 0x7f50240b85f0 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5028ed9640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500c0039c0 0x7f500c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5023fff640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50240b85f0 0x7f500c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5028ed9640 1 -- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50240b85f0 msgr2=0x7f500c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f50296da640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f500c004d50 0x7f500c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5028ed9640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50240b85f0 0x7f500c004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5028ed9640 1 -- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f500c004d50 msgr2=0x7f500c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:04.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5028ed9640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f500c004d50 0x7f500c005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.579+0000 7f5028ed9640 1 -- 172.21.15.77:0/1795030779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c003530 con 0x7f500c0039c0 2024-04-25T13:41:04.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f5028ed9640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500c0039c0 0x7f500c003e30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50240c1370 tx=0x7f501401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc985245f62468e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:04.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014009690 con 0x7f500c0039c0 2024-04-25T13:41:04.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50140059a0 con 0x7f500c0039c0 2024-04-25T13:41:04.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f50237fe640 1 -- 172.21.15.77:0/1795030779 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014005d50 con 0x7f500c0039c0 2024-04-25T13:41:04.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f502b13d640 1 -- 172.21.15.77:0/1795030779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500c0039c0 msgr2=0x7f500c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f502b13d640 1 --2- 172.21.15.77:0/1795030779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500c0039c0 0x7f500c003e30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50240c1370 tx=0x7f501401c9e0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f50296da640 1 -- 172.21.15.77:0/1795030779 reap_dead start 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f502b13d640 1 -- 172.21.15.77:0/1795030779 shutdown_connections 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f502b13d640 1 -- 172.21.15.77:0/1795030779 >> 172.21.15.77:0/1795030779 conn(0x7f50240c02a0 msgr2=0x7f50240c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f502b13d640 1 -- 172.21.15.77:0/1795030779 shutdown_connections 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.583+0000 7f502b13d640 1 -- 172.21.15.77:0/1795030779 wait complete. 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 Processor -- start 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 -- start start 2024-04-25T13:41:04.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f500c0039c0 0x7f502414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502414ae70 0x7f50241595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50241e9950 0x7f5024159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f502415b530 con 0x7f502414ae70 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f502415b3b0 con 0x7f50241e9950 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f502415b6b0 con 0x7f500c0039c0 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5023fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502414ae70 0x7f50241595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5023fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502414ae70 0x7f50241595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35966/0 (socket says 172.21.15.77:35966) 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5023fff640 1 -- 172.21.15.77:0/4015733619 learned_addr learned my addr 172.21.15.77:0/4015733619 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5028ed9640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f500c0039c0 0x7f502414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f50296da640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50241e9950 0x7f5024159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5023fff640 1 -- 172.21.15.77:0/4015733619 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f500c0039c0 msgr2=0x7f502414a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5023fff640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f500c0039c0 0x7f502414a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5023fff640 1 -- 172.21.15.77:0/4015733619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50241e9950 msgr2=0x7f5024159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5023fff640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50241e9950 0x7f5024159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5023fff640 1 -- 172.21.15.77:0/4015733619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5024140bf0 con 0x7f502414ae70 2024-04-25T13:41:04.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f5023fff640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502414ae70 0x7f50241595b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f501800d7a0 tx=0x7f501800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:04.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f50217fa640 1 -- 172.21.15.77:0/4015733619 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018019070 con 0x7f502414ae70 2024-04-25T13:41:04.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f50217fa640 1 -- 172.21.15.77:0/4015733619 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501800de50 con 0x7f502414ae70 2024-04-25T13:41:04.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50241ea950 con 0x7f502414ae70 2024-04-25T13:41:04.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f50217fa640 1 -- 172.21.15.77:0/4015733619 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50180047f0 con 0x7f502414ae70 2024-04-25T13:41:04.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.587+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50241ea150 con 0x7f502414ae70 2024-04-25T13:41:04.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.591+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502406a280 con 0x7f502414ae70 2024-04-25T13:41:04.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.591+0000 7f50217fa640 1 -- 172.21.15.77:0/4015733619 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f501801c070 con 0x7f502414ae70 2024-04-25T13:41:04.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.591+0000 7f50217fa640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f501006f400 0x7f5010071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.591+0000 7f5028ed9640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f501006f400 0x7f5010071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.591+0000 7f50217fa640 1 -- 172.21.15.77:0/4015733619 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f501808ec80 con 0x7f502414ae70 2024-04-25T13:41:04.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.591+0000 7f5028ed9640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f501006f400 0x7f5010071910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50140ae000 tx=0x7f50140b0040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:04.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.595+0000 7f50217fa640 1 -- 172.21.15.77:0/4015733619 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f501805bb70 con 0x7f502414ae70 2024-04-25T13:41:04.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.759+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50240c24e0 con 0x7f502414ae70 2024-04-25T13:41:04.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.759+0000 7f50217fa640 1 -- 172.21.15.77:0/4015733619 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16570 (secure 0 0 0) 0x7f501805b470 con 0x7f502414ae70 2024-04-25T13:41:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:04.762 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:03.799570+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f501006f400 msgr2=0x7f5010071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f501006f400 0x7f5010071910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50140ae000 tx=0x7f50140b0040 comp rx=0 tx=0).stop 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502414ae70 msgr2=0x7f50241595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502414ae70 0x7f50241595b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f501800d7a0 tx=0x7f501800dc60 comp rx=0 tx=0).stop 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 shutdown_connections 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f501006f400 0x7f5010071910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50241e9950 0x7f5024159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502414ae70 0x7f50241595b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 --2- 172.21.15.77:0/4015733619 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f500c0039c0 0x7f502414a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 >> 172.21.15.77:0/4015733619 conn(0x7f50240c02a0 msgr2=0x7f50240a9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:04.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 shutdown_connections 2024-04-25T13:41:04.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.763+0000 7f502b13d640 1 -- 172.21.15.77:0/4015733619 wait complete. 2024-04-25T13:41:04.784 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:04.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f944bf00640 1 Processor -- start 2024-04-25T13:41:04.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f944bf00640 1 -- start start 2024-04-25T13:41:04.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f944bf00640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9444153420 0x7f9444155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f944bf00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94440c3200 con 0x7f94440c6100 2024-04-25T13:41:04.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f944bf00640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94440c34e0 con 0x7f944406dae0 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f944bf00640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f94440c37c0 con 0x7f9444153420 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9449c9c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f94440c6100 0x7f9444152480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42650/0 (socket says 172.21.15.77:42650) 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9449c9c640 1 -- 172.21.15.77:0/3457425642 learned_addr learned my addr 172.21.15.77:0/3457425642 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f944a49d640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9444153420 0x7f9444155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015009293 0 0) 0x7f94440c3200 con 0x7f94440c6100 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f942c003530 con 0x7f94440c6100 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 226001000 0 0) 0x7f942c003530 con 0x7f94440c6100 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9444153420 msgr2=0x7f9444155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9444153420 0x7f9444155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 >> v1:172.21.15.96:6789/0 conn(0x7f944406dae0 legacy=0x7f9444152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944406def0 con 0x7f94440c6100 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f943c001a00 con 0x7f94440c6100 2024-04-25T13:41:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 >> v1:172.21.15.77:6789/0 conn(0x7f94440c6100 legacy=0x7f9444152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f942c0039f0 0x7f942c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9444153420 0x7f942c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f942c004d50 0x7f942c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f94440c37c0 con 0x7f942c0039f0 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f942c00bb00 con 0x7f942c004d50 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.927+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f942c00bd00 con 0x7f9444153420 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9449c9c640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f942c0039f0 0x7f942c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944949b640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9444153420 0x7f942c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944a49d640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f942c004d50 0x7f942c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9449c9c640 1 -- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9444153420 msgr2=0x7f942c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9449c9c640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9444153420 0x7f942c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9449c9c640 1 -- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f942c004d50 msgr2=0x7f942c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9449c9c640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f942c004d50 0x7f942c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9449c9c640 1 -- 172.21.15.77:0/3457425642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c003530 con 0x7f942c0039f0 2024-04-25T13:41:04.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944a49d640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f942c004d50 0x7f942c005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9449c9c640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f942c0039f0 0x7f942c003e60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f943c00a850 tx=0x7f943c01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6c1e695ed39783 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c00a4a0 con 0x7f942c0039f0 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943c0ad650 con 0x7f942c0039f0 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f9448c9a640 1 -- 172.21.15.77:0/3457425642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c0ada40 con 0x7f942c0039f0 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944bf00640 1 -- 172.21.15.77:0/3457425642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f942c0039f0 msgr2=0x7f942c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944bf00640 1 --2- 172.21.15.77:0/3457425642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f942c0039f0 0x7f942c003e60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f943c00a850 tx=0x7f943c01d2e0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944a49d640 1 -- 172.21.15.77:0/3457425642 reap_dead start 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944bf00640 1 -- 172.21.15.77:0/3457425642 shutdown_connections 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944bf00640 1 -- 172.21.15.77:0/3457425642 >> 172.21.15.77:0/3457425642 conn(0x7f94440c79c0 msgr2=0x7f94440c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944bf00640 1 -- 172.21.15.77:0/3457425642 shutdown_connections 2024-04-25T13:41:04.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.931+0000 7f944bf00640 1 -- 172.21.15.77:0/3457425642 wait complete. 2024-04-25T13:41:04.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 Processor -- start 2024-04-25T13:41:04.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 -- start start 2024-04-25T13:41:04.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f942c0039f0 0x7f94441ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9444156b80 0x7f944414e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f944414ead0 0x7f9444157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f94440acc20 con 0x7f9444156b80 2024-04-25T13:41:04.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9444156a00 con 0x7f944414ead0 2024-04-25T13:41:04.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f94440acda0 con 0x7f942c0039f0 2024-04-25T13:41:04.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944949b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9444156b80 0x7f944414e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f9449c9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f942c0039f0 0x7f94441ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f9449c9c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f942c0039f0 0x7f94441ee3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:59788/0 (socket says 172.21.15.77:59788) 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944949b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9444156b80 0x7f944414e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35996/0 (socket says 172.21.15.77:35996) 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f9449c9c640 1 -- 172.21.15.77:0/2360287363 learned_addr learned my addr 172.21.15.77:0/2360287363 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944a49d640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f944414ead0 0x7f9444157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944949b640 1 -- 172.21.15.77:0/2360287363 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f942c0039f0 msgr2=0x7f94441ee3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944949b640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f942c0039f0 0x7f94441ee3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944949b640 1 -- 172.21.15.77:0/2360287363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f944414ead0 msgr2=0x7f9444157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944949b640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f944414ead0 0x7f9444157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944949b640 1 -- 172.21.15.77:0/2360287363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94440a6a50 con 0x7f9444156b80 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944a49d640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f944414ead0 0x7f9444157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944949b640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9444156b80 0x7f944414e590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f943800e440 tx=0x7f943800e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:04.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f94427fc640 1 -- 172.21.15.77:0/2360287363 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438019070 con 0x7f9444156b80 2024-04-25T13:41:04.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f94427fc640 1 -- 172.21.15.77:0/2360287363 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94380052e0 con 0x7f9444156b80 2024-04-25T13:41:04.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9444158ca0 con 0x7f9444156b80 2024-04-25T13:41:04.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f94427fc640 1 -- 172.21.15.77:0/2360287363 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438003840 con 0x7f9444156b80 2024-04-25T13:41:04.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.935+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94441ee900 con 0x7f9444156b80 2024-04-25T13:41:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.939+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9444158a90 con 0x7f9444156b80 2024-04-25T13:41:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.939+0000 7f94427fc640 1 -- 172.21.15.77:0/2360287363 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f943801c070 con 0x7f9444156b80 2024-04-25T13:41:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.939+0000 7f94427fc640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f943006f400 0x7f9430071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.939+0000 7f94427fc640 1 -- 172.21.15.77:0/2360287363 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f943808e840 con 0x7f9444156b80 2024-04-25T13:41:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.939+0000 7f9449c9c640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f943006f400 0x7f9430071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.939+0000 7f9449c9c640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f943006f400 0x7f9430071910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f943c01d320 tx=0x7f943c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:04.943+0000 7f94427fc640 1 -- 172.21.15.77:0/2360287363 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f943805b0e0 con 0x7f9444156b80 2024-04-25T13:41:05.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.103+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94440a6850 con 0x7f9444156b80 2024-04-25T13:41:05.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f94427fc640 1 -- 172.21.15.77:0/2360287363 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16570 (secure 0 0 0) 0x7f94440a6850 con 0x7f9444156b80 2024-04-25T13:41:05.110 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:05.110 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:03.799570+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f943006f400 msgr2=0x7f9430071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f943006f400 0x7f9430071910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f943c01d320 tx=0x7f943c0a7000 comp rx=0 tx=0).stop 2024-04-25T13:41:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9444156b80 msgr2=0x7f944414e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9444156b80 0x7f944414e590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f943800e440 tx=0x7f943800e900 comp rx=0 tx=0).stop 2024-04-25T13:41:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 shutdown_connections 2024-04-25T13:41:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f943006f400 0x7f9430071910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f944414ead0 0x7f9444157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:05.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9444156b80 0x7f944414e590 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 --2- 172.21.15.77:0/2360287363 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f942c0039f0 0x7f94441ee3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 >> 172.21.15.77:0/2360287363 conn(0x7f94440c79c0 msgr2=0x7f94440bd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 shutdown_connections 2024-04-25T13:41:05.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.107+0000 7f944bf00640 1 -- 172.21.15.77:0/2360287363 wait complete. 2024-04-25T13:41:05.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84c1bd7640 1 Processor -- start 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84c1bd7640 1 -- start start 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84c1bd7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f84bc0a6870 0x7f84bc0a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84c1bd7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f84bc0c1ee0 0x7f84bc0c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84c1bd7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84bc0a71c0 con 0x7f84bc0c69b0 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84c1bd7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f84bc153480 con 0x7f84bc0a6870 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84c1bd7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f84bc1529a0 con 0x7f84bc0c1ee0 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84baffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f84bc0a6870 0x7f84bc0a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84bb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f84bc0c69b0 0x7f84bc06dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42660/0 (socket says 172.21.15.77:42660) 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84baffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f84bc0a6870 0x7f84bc0a6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36012/0 (socket says 172.21.15.77:36012) 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84bb7fe640 1 -- 172.21.15.77:0/3386693392 learned_addr learned my addr 172.21.15.77:0/3386693392 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84bbfff640 1 --2- 172.21.15.77:0/3386693392 >> v2:172.21.15.96:3300/0 conn(0x7f84bc0c1ee0 0x7f84bc0c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84baffd640 1 -- 172.21.15.77:0/3386693392 >> v2:172.21.15.96:3300/0 conn(0x7f84bc0c1ee0 msgr2=0x7f84bc0c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84baffd640 1 --2- 172.21.15.77:0/3386693392 >> v2:172.21.15.96:3300/0 conn(0x7f84bc0c1ee0 0x7f84bc0c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84baffd640 1 -- 172.21.15.77:0/3386693392 >> v1:172.21.15.77:6789/0 conn(0x7f84bc0c69b0 legacy=0x7f84bc06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.279+0000 7f84baffd640 1 -- 172.21.15.77:0/3386693392 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc152c80 con 0x7f84bc0a6870 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84baffd640 1 --2- 172.21.15.77:0/3386693392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0a6870 0x7f84bc0a6c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84bc08d570 tx=0x7f84a401c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c637405491e731bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84ba7fc640 1 -- 172.21.15.77:0/3386693392 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a40b0070 con 0x7f84bc0a6870 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84ba7fc640 1 -- 172.21.15.77:0/3386693392 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a40ab600 con 0x7f84bc0a6870 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84ba7fc640 1 -- 172.21.15.77:0/3386693392 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a40ab9d0 con 0x7f84bc0a6870 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84c1bd7640 1 -- 172.21.15.77:0/3386693392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0a6870 msgr2=0x7f84bc0a6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84c1bd7640 1 --2- 172.21.15.77:0/3386693392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0a6870 0x7f84bc0a6c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84bc08d570 tx=0x7f84a401c250 comp rx=0 tx=0).stop 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84c1bd7640 1 -- 172.21.15.77:0/3386693392 shutdown_connections 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84c1bd7640 1 --2- 172.21.15.77:0/3386693392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0a6870 0x7f84bc0a6c80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84c1bd7640 1 --2- 172.21.15.77:0/3386693392 >> v2:172.21.15.96:3300/0 conn(0x7f84bc0c1ee0 0x7f84bc0c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84c1bd7640 1 -- 172.21.15.77:0/3386693392 >> 172.21.15.77:0/3386693392 conn(0x7f84bc0c7890 msgr2=0x7f84bc0c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84c1bd7640 1 -- 172.21.15.77:0/3386693392 shutdown_connections 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.283+0000 7f84c1bd7640 1 -- 172.21.15.77:0/3386693392 wait complete. 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 Processor -- start 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 -- start start 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84bc0a6870 0x7f84bc1efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84bc0c1ee0 0x7f84bc1ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0c69b0 0x7f84bc1ec710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc156630 con 0x7f84bc0c69b0 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc1564b0 con 0x7f84bc0a6870 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc1567b0 con 0x7f84bc0c1ee0 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0c69b0 0x7f84bc1ec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0c69b0 0x7f84bc1ec710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36020/0 (socket says 172.21.15.77:36020) 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bbfff640 1 -- 172.21.15.77:0/2800039802 learned_addr learned my addr 172.21.15.77:0/2800039802 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bb7fe640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84bc0a6870 0x7f84bc1efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84baffd640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84bc0c1ee0 0x7f84bc1ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bbfff640 1 -- 172.21.15.77:0/2800039802 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84bc0c1ee0 msgr2=0x7f84bc1ef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bbfff640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84bc0c1ee0 0x7f84bc1ef3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bbfff640 1 -- 172.21.15.77:0/2800039802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84bc0a6870 msgr2=0x7f84bc1efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bbfff640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84bc0a6870 0x7f84bc1efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bbfff640 1 -- 172.21.15.77:0/2800039802 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc155470 con 0x7f84bc0c69b0 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84bbfff640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0c69b0 0x7f84bc1ec710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00d560 tx=0x7f84ac00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84b3fff640 1 -- 172.21.15.77:0/2800039802 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0125f0 con 0x7f84bc0c69b0 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84b3fff640 1 -- 172.21.15.77:0/2800039802 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac019070 con 0x7f84bc0c69b0 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc0aacf0 con 0x7f84bc0c69b0 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84b3fff640 1 -- 172.21.15.77:0/2800039802 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0129f0 con 0x7f84bc0c69b0 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc0aaf90 con 0x7f84bc0c69b0 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.287+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84bc06a1a0 con 0x7f84bc0c69b0 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.291+0000 7f84b3fff640 1 -- 172.21.15.77:0/2800039802 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f84ac012b90 con 0x7f84bc0c69b0 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.291+0000 7f84b3fff640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f849c06f400 0x7f849c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.291+0000 7f84b3fff640 1 -- 172.21.15.77:0/2800039802 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f84ac08f690 con 0x7f84bc0c69b0 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.291+0000 7f84bb7fe640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f849c06f400 0x7f849c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.291+0000 7f84bb7fe640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f849c06f400 0x7f849c071910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84b40012f0 tx=0x7f84b4005b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:05.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.295+0000 7f84b3fff640 1 -- 172.21.15.77:0/2800039802 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84ac05c610 con 0x7f84bc0c69b0 2024-04-25T13:41:05.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:05.495+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f84bc06ef40 con 0x7f84bc0c69b0 2024-04-25T13:41:06.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.415+0000 7f84b3fff640 1 -- 172.21.15.77:0/2800039802 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f84ac05bf10 con 0x7f84bc0c69b0 2024-04-25T13:41:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f849c06f400 msgr2=0x7f849c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f849c06f400 0x7f849c071910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84b40012f0 tx=0x7f84b4005b80 comp rx=0 tx=0).stop 2024-04-25T13:41:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0c69b0 msgr2=0x7f84bc1ec710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0c69b0 0x7f84bc1ec710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00d560 tx=0x7f84ac00da20 comp rx=0 tx=0).stop 2024-04-25T13:41:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 shutdown_connections 2024-04-25T13:41:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f849c06f400 0x7f849c071910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc0c69b0 0x7f84bc1ec710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84bc0c1ee0 0x7f84bc1ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 --2- 172.21.15.77:0/2800039802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84bc0a6870 0x7f84bc1efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 >> 172.21.15.77:0/2800039802 conn(0x7f84bc0c7890 msgr2=0x7f84bc0a7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 shutdown_connections 2024-04-25T13:41:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.419+0000 7f84c1bd7640 1 -- 172.21.15.77:0/2800039802 wait complete. 2024-04-25T13:41:06.447 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T13:41:06.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T13:41:06.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f31f0640 1 Processor -- start 2024-04-25T13:41:06.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f31f0640 1 -- start start 2024-04-25T13:41:06.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f31f0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec0a5580 0x7f80ec06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:06.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f31f0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f80ec06ff10 0x7f80ec0a7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:06.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f31f0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80ec1535c0 con 0x7f80ec0a7ed0 2024-04-25T13:41:06.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f31f0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f80ec0a3760 con 0x7f80ec06ff10 2024-04-25T13:41:06.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f31f0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f80ec153090 con 0x7f80ec0a5580 2024-04-25T13:41:06.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f178d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f80ec0a7ed0 0x7f80ec14e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42674/0 (socket says 172.21.15.77:42674) 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f178d640 1 -- 172.21.15.77:0/1343718573 learned_addr learned my addr 172.21.15.77:0/1343718573 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f0f8c640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec0a5580 0x7f80ec06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80ebfff640 1 --2- 172.21.15.77:0/1343718573 >> v2:172.21.15.96:3300/0 conn(0x7f80ec06ff10 0x7f80ec0a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2662980634 0 0) 0x7f80ec1535c0 con 0x7f80ec0a7ed0 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80d4003530 con 0x7f80ec0a7ed0 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3159544869 0 0) 0x7f80d4003530 con 0x7f80ec0a7ed0 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec0a5580 msgr2=0x7f80ec06f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec0a5580 0x7f80ec06f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 >> v2:172.21.15.96:3300/0 conn(0x7f80ec06ff10 msgr2=0x7f80ec0a7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 --2- 172.21.15.77:0/1343718573 >> v2:172.21.15.96:3300/0 conn(0x7f80ec06ff10 0x7f80ec0a7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec0a5990 con 0x7f80ec0a7ed0 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f80dc001a00 con 0x7f80ec0a7ed0 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 >> v1:172.21.15.77:6789/0 conn(0x7f80ec0a7ed0 legacy=0x7f80ec14e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec0a5580 0x7f80d4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d4003fb0 0x7f80d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d4004d50 0x7f80d4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec0a3760 con 0x7f80d4004d50 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec153090 con 0x7f80d4003fb0 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f80d400bb30 con 0x7f80ec0a5580 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f178d640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d4004d50 0x7f80d4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80ebfff640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d4003fb0 0x7f80d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f0f8c640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec0a5580 0x7f80d4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f178d640 1 -- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec0a5580 msgr2=0x7f80d4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f178d640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec0a5580 0x7f80d4003a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f178d640 1 -- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d4003fb0 msgr2=0x7f80d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f178d640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80d4003fb0 0x7f80d4004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.607+0000 7f80f178d640 1 -- 172.21.15.77:0/1343718573 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d4003530 con 0x7f80d4004d50 2024-04-25T13:41:06.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80f178d640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d4004d50 0x7f80d4005160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00a870 tx=0x7f80dc01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c7f8feea39117 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:06.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00a4c0 con 0x7f80d4004d50 2024-04-25T13:41:06.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80dc0ad650 con 0x7f80d4004d50 2024-04-25T13:41:06.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80eb7fe640 1 -- 172.21.15.77:0/1343718573 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0ada80 con 0x7f80d4004d50 2024-04-25T13:41:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80f31f0640 1 -- 172.21.15.77:0/1343718573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d4004d50 msgr2=0x7f80d4005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80f31f0640 1 --2- 172.21.15.77:0/1343718573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d4004d50 0x7f80d4005160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00a870 tx=0x7f80dc01d3a0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80f178d640 1 -- 172.21.15.77:0/1343718573 reap_dead start 2024-04-25T13:41:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80f31f0640 1 -- 172.21.15.77:0/1343718573 shutdown_connections 2024-04-25T13:41:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80f31f0640 1 -- 172.21.15.77:0/1343718573 >> 172.21.15.77:0/1343718573 conn(0x7f80ec0c3cd0 msgr2=0x7f80ec0c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80f31f0640 1 -- 172.21.15.77:0/1343718573 shutdown_connections 2024-04-25T13:41:06.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.611+0000 7f80f31f0640 1 -- 172.21.15.77:0/1343718573 wait complete. 2024-04-25T13:41:06.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 Processor -- start 2024-04-25T13:41:06.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 -- start start 2024-04-25T13:41:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec1520c0 0x7f80ec14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ec152580 0x7f80ec143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec143dc0 0x7f80ec1e86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec14fe30 con 0x7f80ec1520c0 2024-04-25T13:41:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec153340 con 0x7f80ec152580 2024-04-25T13:41:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f80ec071ea0 con 0x7f80ec143dc0 2024-04-25T13:41:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f0f8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec1520c0 0x7f80ec14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f0f8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec1520c0 0x7f80ec14c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36040/0 (socket says 172.21.15.77:36040) 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f0f8c640 1 -- 172.21.15.77:0/3774166741 learned_addr learned my addr 172.21.15.77:0/3774166741 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f178d640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec143dc0 0x7f80ec1e86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80ebfff640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ec152580 0x7f80ec143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f0f8c640 1 -- 172.21.15.77:0/3774166741 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec143dc0 msgr2=0x7f80ec1e86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f0f8c640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec143dc0 0x7f80ec1e86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f0f8c640 1 -- 172.21.15.77:0/3774166741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ec152580 msgr2=0x7f80ec143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f0f8c640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ec152580 0x7f80ec143880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f0f8c640 1 -- 172.21.15.77:0/3774166741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec1511c0 con 0x7f80ec1520c0 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f0f8c640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec1520c0 0x7f80ec14c4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f80e4010890 tx=0x7f80e4010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80e97fa640 1 -- 172.21.15.77:0/3774166741 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e400f040 con 0x7f80ec1520c0 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80e97fa640 1 -- 172.21.15.77:0/3774166741 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e400eb60 con 0x7f80ec1520c0 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ec1514a0 con 0x7f80ec1520c0 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80e97fa640 1 -- 172.21.15.77:0/3774166741 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e401c400 con 0x7f80ec1520c0 2024-04-25T13:41:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ec1e8180 con 0x7f80ec1520c0 2024-04-25T13:41:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.615+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80ec06a1a0 con 0x7f80ec1520c0 2024-04-25T13:41:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.619+0000 7f80e97fa640 1 -- 172.21.15.77:0/3774166741 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f80e401c5a0 con 0x7f80ec1520c0 2024-04-25T13:41:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.619+0000 7f80e97fa640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f80d806f3a0 0x7f80d80718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.619+0000 7f80e97fa640 1 -- 172.21.15.77:0/3774166741 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f80e408fc90 con 0x7f80ec1520c0 2024-04-25T13:41:06.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.619+0000 7f80ebfff640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f80d806f3a0 0x7f80d80718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:06.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.619+0000 7f80ebfff640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f80d806f3a0 0x7f80d80718b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80ec070320 tx=0x7f80e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:06.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.623+0000 7f80e97fa640 1 -- 172.21.15.77:0/3774166741 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80e4018030 con 0x7f80ec1520c0 2024-04-25T13:41:06.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:06.819+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f80ec0c33c0 con 0x7f80ec1520c0 2024-04-25T13:41:07.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.419+0000 7f80e97fa640 1 -- 172.21.15.77:0/3774166741 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f80e405cd80 con 0x7f80ec1520c0 2024-04-25T13:41:07.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f80d806f3a0 msgr2=0x7f80d80718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f80d806f3a0 0x7f80d80718b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80ec070320 tx=0x7f80e0008040 comp rx=0 tx=0).stop 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec1520c0 msgr2=0x7f80ec14c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec1520c0 0x7f80ec14c4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f80e4010890 tx=0x7f80e4010d50 comp rx=0 tx=0).stop 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 shutdown_connections 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f80d806f3a0 0x7f80d80718b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80ec143dc0 0x7f80ec1e86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80ec152580 0x7f80ec143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 --2- 172.21.15.77:0/3774166741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec1520c0 0x7f80ec14c4d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 >> 172.21.15.77:0/3774166741 conn(0x7f80ec0c3cd0 msgr2=0x7f80ec14e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 shutdown_connections 2024-04-25T13:41:07.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.423+0000 7f80f31f0640 1 -- 172.21.15.77:0/3774166741 wait complete. 2024-04-25T13:41:07.447 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T13:41:07.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa6101e7640 1 Processor -- start 2024-04-25T13:41:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa6101e7640 1 -- start start 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa6101e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa6080a5da0 0x7fa60806f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa6101e7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa60806fdf0 0x7fa6081526c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa6101e7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa608152c00 0x7fa608153010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa6101e7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa608153550 con 0x7fa6080a5da0 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa6101e7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fa608074770 con 0x7fa60806fdf0 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa6101e7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fa6080a8900 con 0x7fa608152c00 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60df83640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa6080a5da0 0x7fa60806f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60df83640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa6080a5da0 0x7fa60806f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36042/0 (socket says 172.21.15.77:36042) 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60df83640 1 -- 172.21.15.77:0/1927269833 learned_addr learned my addr 172.21.15.77:0/1927269833 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60e784640 1 --2- 172.21.15.77:0/1927269833 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa608152c00 0x7fa608153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60d782640 1 --2- 172.21.15.77:0/1927269833 >> v2:172.21.15.96:3300/0 conn(0x7fa60806fdf0 0x7fa6081526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60df83640 1 -- 172.21.15.77:0/1927269833 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa608152c00 msgr2=0x7fa608153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60df83640 1 --2- 172.21.15.77:0/1927269833 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa608152c00 0x7fa608153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60df83640 1 -- 172.21.15.77:0/1927269833 >> v2:172.21.15.96:3300/0 conn(0x7fa60806fdf0 msgr2=0x7fa6081526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60df83640 1 --2- 172.21.15.77:0/1927269833 >> v2:172.21.15.96:3300/0 conn(0x7fa60806fdf0 0x7fa6081526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.599+0000 7fa60df83640 1 -- 172.21.15.77:0/1927269833 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6080a8ba0 con 0x7fa6080a5da0 2024-04-25T13:41:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa60df83640 1 --2- 172.21.15.77:0/1927269833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6080a5da0 0x7fa60806f8b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa6080c1250 tx=0x7fa60401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bc220701d0d5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa60cf81640 1 -- 172.21.15.77:0/1927269833 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6040b0070 con 0x7fa6080a5da0 2024-04-25T13:41:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa60cf81640 1 -- 172.21.15.77:0/1927269833 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6040ab600 con 0x7fa6080a5da0 2024-04-25T13:41:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa60cf81640 1 -- 172.21.15.77:0/1927269833 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6040ab9d0 con 0x7fa6080a5da0 2024-04-25T13:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 -- 172.21.15.77:0/1927269833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6080a5da0 msgr2=0x7fa60806f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 --2- 172.21.15.77:0/1927269833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6080a5da0 0x7fa60806f8b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa6080c1250 tx=0x7fa60401c470 comp rx=0 tx=0).stop 2024-04-25T13:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 -- 172.21.15.77:0/1927269833 shutdown_connections 2024-04-25T13:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 --2- 172.21.15.77:0/1927269833 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa608152c00 0x7fa608153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 --2- 172.21.15.77:0/1927269833 >> v2:172.21.15.96:3300/0 conn(0x7fa60806fdf0 0x7fa6081526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 --2- 172.21.15.77:0/1927269833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6080a5da0 0x7fa60806f8b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 -- 172.21.15.77:0/1927269833 >> 172.21.15.77:0/1927269833 conn(0x7fa6080c02a0 msgr2=0x7fa6080c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 -- 172.21.15.77:0/1927269833 shutdown_connections 2024-04-25T13:41:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 -- 172.21.15.77:0/1927269833 wait complete. 2024-04-25T13:41:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 Processor -- start 2024-04-25T13:41:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.603+0000 7fa6101e7640 1 -- start start 2024-04-25T13:41:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa6101e7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa60806fdf0 0x7fa608157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa6101e7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6080a5da0 0x7fa608159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa6101e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608152c00 0x7fa6081459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa6101e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6080724a0 con 0x7fa608152c00 2024-04-25T13:41:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa6101e7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa608072320 con 0x7fa6080a5da0 2024-04-25T13:41:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa6101e7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fa608072620 con 0x7fa60806fdf0 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60e784640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608152c00 0x7fa6081459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60e784640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608152c00 0x7fa6081459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36052/0 (socket says 172.21.15.77:36052) 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60e784640 1 -- 172.21.15.77:0/2787141062 learned_addr learned my addr 172.21.15.77:0/2787141062 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60df83640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa60806fdf0 0x7fa608157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60d782640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6080a5da0 0x7fa608159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60e784640 1 -- 172.21.15.77:0/2787141062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa60806fdf0 msgr2=0x7fa608157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60e784640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa60806fdf0 0x7fa608157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60e784640 1 -- 172.21.15.77:0/2787141062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6080a5da0 msgr2=0x7fa608159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60e784640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6080a5da0 0x7fa608159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60e784640 1 -- 172.21.15.77:0/2787141062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60815b6b0 con 0x7fa608152c00 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60d782640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6080a5da0 0x7fa608159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60e784640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608152c00 0x7fa6081459d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa600007cf0 tx=0x7fa60000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa5fe7fc640 1 -- 172.21.15.77:0/2787141062 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600014420 con 0x7fa608152c00 2024-04-25T13:41:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa5fe7fc640 1 -- 172.21.15.77:0/2787141062 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa600019070 con 0x7fa608152c00 2024-04-25T13:41:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60815a440 con 0x7fa608152c00 2024-04-25T13:41:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa5fe7fc640 1 -- 172.21.15.77:0/2787141062 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600014820 con 0x7fa608152c00 2024-04-25T13:41:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60815b990 con 0x7fa608152c00 2024-04-25T13:41:07.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60815b4c0 con 0x7fa608152c00 2024-04-25T13:41:07.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa5fe7fc640 1 -- 172.21.15.77:0/2787141062 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa6000149c0 con 0x7fa608152c00 2024-04-25T13:41:07.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa5fe7fc640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa5ec06f400 0x7fa5ec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa60df83640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa5ec06f400 0x7fa5ec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.607+0000 7fa5fe7fc640 1 -- 172.21.15.77:0/2787141062 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa600090470 con 0x7fa608152c00 2024-04-25T13:41:07.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.611+0000 7fa60df83640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa5ec06f400 0x7fa5ec071910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa6040ad000 tx=0x7fa6040a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:07.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.611+0000 7fa5fe7fc640 1 -- 172.21.15.77:0/2787141062 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa60005d4d0 con 0x7fa608152c00 2024-04-25T13:41:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.807+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa608153330 con 0x7fa608152c00 2024-04-25T13:41:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.807+0000 7fa5fe7fc640 1 -- 172.21.15.77:0/2787141062 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7fa60005cdd0 con 0x7fa608152c00 2024-04-25T13:41:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:07.808 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2393103049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2393103049},{"type":"v1","addr":"172.21.15.77:6835","nonce":2393103049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:41:03.799479+0000","modified":"2024-04-25T13:41:06.824136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6833/1035589958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":1035589958},{"type":"v1","addr":"172.21.15.96:6833","nonce":1035589958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-25T13:41:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.807+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa5ec06f400 msgr2=0x7fa5ec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.807+0000 7fa6101e7640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa5ec06f400 0x7fa5ec071910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa6040ad000 tx=0x7fa6040a6000 comp rx=0 tx=0).stop 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.807+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608152c00 msgr2=0x7fa6081459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.807+0000 7fa6101e7640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608152c00 0x7fa6081459d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa600007cf0 tx=0x7fa60000e4b0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.811+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 shutdown_connections 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.811+0000 7fa6101e7640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa5ec06f400 0x7fa5ec071910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.811+0000 7fa6101e7640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608152c00 0x7fa6081459d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.811+0000 7fa6101e7640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6080a5da0 0x7fa608159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.811+0000 7fa6101e7640 1 --2- 172.21.15.77:0/2787141062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa60806fdf0 0x7fa608157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.811+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 >> 172.21.15.77:0/2787141062 conn(0x7fa6080c02a0 msgr2=0x7fa608147580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:07.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.811+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 shutdown_connections 2024-04-25T13:41:07.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.811+0000 7fa6101e7640 1 -- 172.21.15.77:0/2787141062 wait complete. 2024-04-25T13:41:07.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:07.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39b62af640 1 Processor -- start 2024-04-25T13:41:07.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39b62af640 1 -- start start 2024-04-25T13:41:07.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39b62af640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f39b014e9e0 0x7f39b014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39b62af640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b00a8900 con 0x7f39b014f330 2024-04-25T13:41:07.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39b62af640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b00a8ba0 con 0x7f39b00a5da0 2024-04-25T13:41:07.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39b62af640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f39b0074770 con 0x7f39b014e9e0 2024-04-25T13:41:07.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39b484c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f39b014f330 0x7f39b014f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42682/0 (socket says 172.21.15.77:42682) 2024-04-25T13:41:07.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39b484c640 1 -- 172.21.15.77:0/3639320933 learned_addr learned my addr 172.21.15.77:0/3639320933 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:07.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39af7fe640 1 --2- 172.21.15.77:0/3639320933 >> v2:172.21.15.96:3300/0 conn(0x7f39b014e9e0 0x7f39b014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193618601 0 0) 0x7f39b00a8900 con 0x7f39b014f330 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3998003530 con 0x7f39b014f330 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3586687243 0 0) 0x7f3998003530 con 0x7f39b014f330 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 >> v2:172.21.15.96:3300/0 conn(0x7f39b014e9e0 msgr2=0x7f39b014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 --2- 172.21.15.77:0/3639320933 >> v2:172.21.15.96:3300/0 conn(0x7f39b014e9e0 0x7f39b014edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 >> v1:172.21.15.96:6789/0 conn(0x7f39b00a5da0 legacy=0x7f39b006f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b00a7c00 con 0x7f39b014f330 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f39a8001a20 con 0x7f39b014f330 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 >> v1:172.21.15.77:6789/0 conn(0x7f39b014f330 legacy=0x7f39b014f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f3998003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3998004810 0x7f3998004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3998005260 0x7f399800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39b0074770 con 0x7f39980039c0 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f399800c1f0 con 0x7f3998005260 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f399800c3f0 con 0x7f3998004810 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.971+0000 7f39affff640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f3998003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39af7fe640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3998004810 0x7f3998004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39b484c640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3998005260 0x7f399800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39affff640 1 -- 172.21.15.77:0/3639320933 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3998004810 msgr2=0x7f3998004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39affff640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3998004810 0x7f3998004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39affff640 1 -- 172.21.15.77:0/3639320933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3998005260 msgr2=0x7f399800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39affff640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3998005260 0x7f399800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39affff640 1 -- 172.21.15.77:0/3639320933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3998003530 con 0x7f39980039c0 2024-04-25T13:41:07.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39b484c640 1 -- 172.21.15.77:0/3639320933 reap_dead start 2024-04-25T13:41:07.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39affff640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f3998003e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39a0001780 tx=0x7f39a001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770317867bf062b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:07.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a00013d0 con 0x7f39980039c0 2024-04-25T13:41:07.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a00052d0 con 0x7f39980039c0 2024-04-25T13:41:07.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39aeffd640 1 -- 172.21.15.77:0/3639320933 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0003650 con 0x7f39980039c0 2024-04-25T13:41:07.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39b62af640 1 -- 172.21.15.77:0/3639320933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 msgr2=0x7f3998003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39b62af640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f3998003e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39a0001780 tx=0x7f39a001c3a0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39b62af640 1 -- 172.21.15.77:0/3639320933 shutdown_connections 2024-04-25T13:41:07.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39b62af640 1 --2- 172.21.15.77:0/3639320933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f3998003e30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39b62af640 1 -- 172.21.15.77:0/3639320933 >> 172.21.15.77:0/3639320933 conn(0x7f39b00c02a0 msgr2=0x7f39b00c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:07.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39b62af640 1 -- 172.21.15.77:0/3639320933 shutdown_connections 2024-04-25T13:41:07.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.975+0000 7f39b62af640 1 -- 172.21.15.77:0/3639320933 wait complete. 2024-04-25T13:41:07.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 Processor -- start 2024-04-25T13:41:07.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 -- start start 2024-04-25T13:41:07.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f39b0152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39b00b8b30 0x7f39b0072530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f39b0151630 0x7f39b0148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39b014fad0 con 0x7f39980039c0 2024-04-25T13:41:07.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f39b014f950 con 0x7f39b00b8b30 2024-04-25T13:41:07.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f39b014fc50 con 0x7f39b0151630 2024-04-25T13:41:07.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f39b0152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f39b0152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36068/0 (socket says 172.21.15.77:36068) 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39affff640 1 -- 172.21.15.77:0/3949083685 learned_addr learned my addr 172.21.15.77:0/3949083685 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39af7fe640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39b00b8b30 0x7f39b0072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b484c640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f39b0151630 0x7f39b0148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39affff640 1 -- 172.21.15.77:0/3949083685 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f39b0151630 msgr2=0x7f39b0148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39affff640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f39b0151630 0x7f39b0148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39affff640 1 -- 172.21.15.77:0/3949083685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39b00b8b30 msgr2=0x7f39b0072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39affff640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39b00b8b30 0x7f39b0072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39affff640 1 -- 172.21.15.77:0/3949083685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b0072a70 con 0x7f39980039c0 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39affff640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f39b0152fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f39a0005040 tx=0x7f3998005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39acff9640 1 -- 172.21.15.77:0/3949083685 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a00013d0 con 0x7f39980039c0 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39acff9640 1 -- 172.21.15.77:0/3949083685 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a00bb070 con 0x7f39980039c0 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b01e8230 con 0x7f39980039c0 2024-04-25T13:41:07.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39acff9640 1 -- 172.21.15.77:0/3949083685 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0007280 con 0x7f39980039c0 2024-04-25T13:41:07.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.979+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b01524d0 con 0x7f39980039c0 2024-04-25T13:41:07.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.983+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b006a280 con 0x7f39980039c0 2024-04-25T13:41:07.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.983+0000 7f39acff9640 1 -- 172.21.15.77:0/3949083685 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f39a0007420 con 0x7f39980039c0 2024-04-25T13:41:07.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.983+0000 7f39acff9640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f399c06f400 0x7f399c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:07.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.983+0000 7f39af7fe640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f399c06f400 0x7f399c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:07.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.983+0000 7f39acff9640 1 -- 172.21.15.77:0/3949083685 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f39a0129820 con 0x7f39980039c0 2024-04-25T13:41:07.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.983+0000 7f39af7fe640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f399c06f400 0x7f399c071910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f39b0151e70 tx=0x7f39a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:07.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:07.987+0000 7f39acff9640 1 -- 172.21.15.77:0/3949083685 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39a00160b0 con 0x7f39980039c0 2024-04-25T13:41:08.104 INFO:tasks.ceph.mds.b.smithi096.stderr:2024-04-25T13:41:08.105+0000 7ff8fd1f4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:41:08.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.147+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39b006d5c0 con 0x7f39980039c0 2024-04-25T13:41:08.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39acff9640 1 -- 172.21.15.77:0/3949083685 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7f39a00f6710 con 0x7f39980039c0 2024-04-25T13:41:08.152 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:08.152 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:05.383876+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f399c06f400 msgr2=0x7f399c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f399c06f400 0x7f399c071910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f39b0151e70 tx=0x7f39a4008040 comp rx=0 tx=0).stop 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 msgr2=0x7f39b0152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f39b0152fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f39a0005040 tx=0x7f3998005840 comp rx=0 tx=0).stop 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 shutdown_connections 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f399c06f400 0x7f399c071910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f39b0151630 0x7f39b0148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39b00b8b30 0x7f39b0072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 --2- 172.21.15.77:0/3949083685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39980039c0 0x7f39b0152fb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 >> 172.21.15.77:0/3949083685 conn(0x7f39b00c02a0 msgr2=0x7f39b014dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 shutdown_connections 2024-04-25T13:41:08.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.151+0000 7f39b62af640 1 -- 172.21.15.77:0/3949083685 wait complete. 2024-04-25T13:41:08.172 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T13:41:08.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:41:08.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d3625640 1 Processor -- start 2024-04-25T13:41:08.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d3625640 1 -- start start 2024-04-25T13:41:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d3625640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f70cc14f500 0x7f70cc14f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d3625640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70cc0a8900 con 0x7f70cc0a5da0 2024-04-25T13:41:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d3625640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70cc0a8ba0 con 0x7f70cc14e9e0 2024-04-25T13:41:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d3625640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f70cc074770 con 0x7f70cc14f500 2024-04-25T13:41:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d13c1640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f70cc0a5da0 0x7f70cc06f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42696/0 (socket says 172.21.15.77:42696) 2024-04-25T13:41:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d13c1640 1 -- 172.21.15.77:0/3894452681 learned_addr learned my addr 172.21.15.77:0/3894452681 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d1bc2640 1 --2- 172.21.15.77:0/3894452681 >> v2:172.21.15.77:3300/0 conn(0x7f70cc14f500 0x7f70cc14f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d1bc2640 1 -- 172.21.15.77:0/3894452681 >> v1:172.21.15.96:6789/0 conn(0x7f70cc14e9e0 legacy=0x7f70cc14edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d1bc2640 1 -- 172.21.15.77:0/3894452681 >> v1:172.21.15.77:6789/0 conn(0x7f70cc0a5da0 legacy=0x7f70cc06f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70d1bc2640 1 -- 172.21.15.77:0/3894452681 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc0a7c00 con 0x7f70cc14f500 2024-04-25T13:41:08.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.307+0000 7f70cbfff640 1 -- 172.21.15.77:0/3894452681 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550079203 0 0) 0x7f70cc0a8900 con 0x7f70cc0a5da0 2024-04-25T13:41:08.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d1bc2640 1 --2- 172.21.15.77:0/3894452681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14f500 0x7f70cc14f910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70c40097c0 tx=0x7f70c401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e361faf4dde54a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:08.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70cbfff640 1 -- 172.21.15.77:0/3894452681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c40b0070 con 0x7f70cc14f500 2024-04-25T13:41:08.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70cbfff640 1 -- 172.21.15.77:0/3894452681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c40ab600 con 0x7f70cc14f500 2024-04-25T13:41:08.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70cbfff640 1 -- 172.21.15.77:0/3894452681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c40ab9d0 con 0x7f70cc14f500 2024-04-25T13:41:08.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d3625640 1 -- 172.21.15.77:0/3894452681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14f500 msgr2=0x7f70cc14f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d3625640 1 --2- 172.21.15.77:0/3894452681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14f500 0x7f70cc14f910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70c40097c0 tx=0x7f70c401c410 comp rx=0 tx=0).stop 2024-04-25T13:41:08.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d3625640 1 -- 172.21.15.77:0/3894452681 shutdown_connections 2024-04-25T13:41:08.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d3625640 1 --2- 172.21.15.77:0/3894452681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14f500 0x7f70cc14f910 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d3625640 1 -- 172.21.15.77:0/3894452681 >> 172.21.15.77:0/3894452681 conn(0x7f70cc0c02a0 msgr2=0x7f70cc0c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:08.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d3625640 1 -- 172.21.15.77:0/3894452681 shutdown_connections 2024-04-25T13:41:08.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d3625640 1 -- 172.21.15.77:0/3894452681 wait complete. 2024-04-25T13:41:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d3625640 1 Processor -- start 2024-04-25T13:41:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.311+0000 7f70d3625640 1 -- start start 2024-04-25T13:41:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d3625640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f70cc0a5da0 0x7f70cc1ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d3625640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14e9e0 0x7f70cc1439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d3625640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70cc14f500 0x7f70cc1ea950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d3625640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc15da20 con 0x7f70cc14e9e0 2024-04-25T13:41:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d3625640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc15d8a0 con 0x7f70cc14f500 2024-04-25T13:41:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d3625640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f70cc15dba0 con 0x7f70cc0a5da0 2024-04-25T13:41:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d0bc0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14e9e0 0x7f70cc1439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d0bc0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14e9e0 0x7f70cc1439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36078/0 (socket says 172.21.15.77:36078) 2024-04-25T13:41:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d0bc0640 1 -- 172.21.15.77:0/3293166167 learned_addr learned my addr 172.21.15.77:0/3293166167 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d13c1640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f70cc0a5da0 0x7f70cc1ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d1bc2640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70cc14f500 0x7f70cc1ea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d0bc0640 1 -- 172.21.15.77:0/3293166167 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f70cc0a5da0 msgr2=0x7f70cc1ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d0bc0640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f70cc0a5da0 0x7f70cc1ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d0bc0640 1 -- 172.21.15.77:0/3293166167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70cc14f500 msgr2=0x7f70cc1ea950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d0bc0640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70cc14f500 0x7f70cc1ea950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d0bc0640 1 -- 172.21.15.77:0/3293166167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc1ea610 con 0x7f70cc14e9e0 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d0bc0640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14e9e0 0x7f70cc1439e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c3c0 tx=0x7f70c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70c9ffb640 1 -- 172.21.15.77:0/3293166167 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0017070 con 0x7f70cc14e9e0 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70c9ffb640 1 -- 172.21.15.77:0/3293166167 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c00052d0 con 0x7f70cc14e9e0 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70c9ffb640 1 -- 172.21.15.77:0/3293166167 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0003820 con 0x7f70cc14e9e0 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70cc1e95f0 con 0x7f70cc14e9e0 2024-04-25T13:41:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70cc1e9bb0 con 0x7f70cc14e9e0 2024-04-25T13:41:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70cc06a280 con 0x7f70cc14e9e0 2024-04-25T13:41:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.315+0000 7f70c9ffb640 1 -- 172.21.15.77:0/3293166167 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f70c001a070 con 0x7f70cc14e9e0 2024-04-25T13:41:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.319+0000 7f70c9ffb640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f70b806f400 0x7f70b8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.319+0000 7f70c9ffb640 1 -- 172.21.15.77:0/3293166167 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f70c008e5f0 con 0x7f70cc14e9e0 2024-04-25T13:41:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.319+0000 7f70d13c1640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f70b806f400 0x7f70b8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.319+0000 7f70d13c1640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f70b806f400 0x7f70b8071910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f70bc007df0 tx=0x7f70bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:08.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.323+0000 7f70c9ffb640 1 -- 172.21.15.77:0/3293166167 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70c0005480 con 0x7f70cc14e9e0 2024-04-25T13:41:08.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.471+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70cc13ecc0 con 0x7f70b806f400 2024-04-25T13:41:08.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.483+0000 7f70c9ffb640 1 -- 172.21.15.77:0/3293166167 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252017 (secure 0 0 0) 0x7f70cc13ecc0 con 0x7f70b806f400 2024-04-25T13:41:08.485 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:08.488 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T13:41:08.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f70b806f400 msgr2=0x7f70b8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f70b806f400 0x7f70b8071910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f70bc007df0 tx=0x7f70bc009040 comp rx=0 tx=0).stop 2024-04-25T13:41:08.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14e9e0 msgr2=0x7f70cc1439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14e9e0 0x7f70cc1439e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c3c0 tx=0x7f70c000c880 comp rx=0 tx=0).stop 2024-04-25T13:41:08.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 shutdown_connections 2024-04-25T13:41:08.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f70b806f400 0x7f70b8071910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70cc14f500 0x7f70cc1ea950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70cc14e9e0 0x7f70cc1439e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 --2- 172.21.15.77:0/3293166167 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f70cc0a5da0 0x7f70cc1ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 >> 172.21.15.77:0/3293166167 conn(0x7f70cc0c02a0 msgr2=0x7f70cc0c14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:08.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 shutdown_connections 2024-04-25T13:41:08.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.487+0000 7f70d3625640 1 -- 172.21.15.77:0/3293166167 wait complete. 2024-04-25T13:41:08.505 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-25T13:41:08.366157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218048,"kb_used_data":1864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756672,"statfs":{"total":773094113280,"available":772870832128,"internally_reserved":0,"allocated":1908736,"data_stored":1777796,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.979698"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376520+0000","last_change":"2024-04-25T13:41:04.470225+0000","last_active":"2024-04-25T13:41:06.376520+0000","last_peered":"2024-04-25T13:41:06.376520+0000","last_clean":"2024-04-25T13:41:06.376520+0000","last_became_active":"2024-04-25T13:41:04.434108+0000","last_became_peered":"2024-04-25T13:41:04.434108+0000","last_unstale":"2024-04-25T13:41:06.376520+0000","last_undegraded":"2024-04-25T13:41:06.376520+0000","last_fullsized":"2024-04-25T13:41:06.376520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394570+0000","last_change":"2024-04-25T13:41:04.422886+0000","last_active":"2024-04-25T13:41:05.394570+0000","last_peered":"2024-04-25T13:41:05.394570+0000","last_clean":"2024-04-25T13:41:05.394570+0000","last_became_active":"2024-04-25T13:41:04.422546+0000","last_became_peered":"2024-04-25T13:41:04.422546+0000","last_unstale":"2024-04-25T13:41:05.394570+0000","last_undegraded":"2024-04-25T13:41:05.394570+0000","last_fullsized":"2024-04-25T13:41:05.394570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080522+0000","last_change":"2024-04-25T13:41:04.413021+0000","last_active":"2024-04-25T13:41:07.080522+0000","last_peered":"2024-04-25T13:41:07.080522+0000","last_clean":"2024-04-25T13:41:07.080522+0000","last_became_active":"2024-04-25T13:41:04.412382+0000","last_became_peered":"2024-04-25T13:41:04.412382+0000","last_unstale":"2024-04-25T13:41:07.080522+0000","last_undegraded":"2024-04-25T13:41:07.080522+0000","last_fullsized":"2024-04-25T13:41:07.080522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398030+0000","last_change":"2024-04-25T13:41:04.419756+0000","last_active":"2024-04-25T13:41:05.398030+0000","last_peered":"2024-04-25T13:41:05.398030+0000","last_clean":"2024-04-25T13:41:05.398030+0000","last_became_active":"2024-04-25T13:41:04.418367+0000","last_became_peered":"2024-04-25T13:41:04.418367+0000","last_unstale":"2024-04-25T13:41:05.398030+0000","last_undegraded":"2024-04-25T13:41:05.398030+0000","last_fullsized":"2024-04-25T13:41:05.398030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375397+0000","last_change":"2024-04-25T13:41:04.428788+0000","last_active":"2024-04-25T13:41:06.375397+0000","last_peered":"2024-04-25T13:41:06.375397+0000","last_clean":"2024-04-25T13:41:06.375397+0000","last_became_active":"2024-04-25T13:41:04.428424+0000","last_became_peered":"2024-04-25T13:41:04.428424+0000","last_unstale":"2024-04-25T13:41:06.375397+0000","last_undegraded":"2024-04-25T13:41:06.375397+0000","last_fullsized":"2024-04-25T13:41:06.375397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397757+0000","last_change":"2024-04-25T13:41:04.432387+0000","last_active":"2024-04-25T13:41:05.397757+0000","last_peered":"2024-04-25T13:41:05.397757+0000","last_clean":"2024-04-25T13:41:05.397757+0000","last_became_active":"2024-04-25T13:41:04.431971+0000","last_became_peered":"2024-04-25T13:41:04.431971+0000","last_unstale":"2024-04-25T13:41:05.397757+0000","last_undegraded":"2024-04-25T13:41:05.397757+0000","last_fullsized":"2024-04-25T13:41:05.397757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375149+0000","last_change":"2024-04-25T13:41:04.473786+0000","last_active":"2024-04-25T13:41:06.375149+0000","last_peered":"2024-04-25T13:41:06.375149+0000","last_clean":"2024-04-25T13:41:06.375149+0000","last_became_active":"2024-04-25T13:41:04.471082+0000","last_became_peered":"2024-04-25T13:41:04.471082+0000","last_unstale":"2024-04-25T13:41:06.375149+0000","last_undegraded":"2024-04-25T13:41:06.375149+0000","last_fullsized":"2024-04-25T13:41:06.375149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271553+0000","last_change":"2024-04-25T13:41:04.410956+0000","last_active":"2024-04-25T13:41:06.271553+0000","last_peered":"2024-04-25T13:41:06.271553+0000","last_clean":"2024-04-25T13:41:06.271553+0000","last_became_active":"2024-04-25T13:41:04.410665+0000","last_became_peered":"2024-04-25T13:41:04.410665+0000","last_unstale":"2024-04-25T13:41:06.271553+0000","last_undegraded":"2024-04-25T13:41:06.271553+0000","last_fullsized":"2024-04-25T13:41:06.271553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376873+0000","last_change":"2024-04-25T13:41:04.470410+0000","last_active":"2024-04-25T13:41:06.376873+0000","last_peered":"2024-04-25T13:41:06.376873+0000","last_clean":"2024-04-25T13:41:06.376873+0000","last_became_active":"2024-04-25T13:41:04.434676+0000","last_became_peered":"2024-04-25T13:41:04.434676+0000","last_unstale":"2024-04-25T13:41:06.376873+0000","last_undegraded":"2024-04-25T13:41:06.376873+0000","last_fullsized":"2024-04-25T13:41:06.376873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083063+0000","last_change":"2024-04-25T13:41:04.417498+0000","last_active":"2024-04-25T13:41:07.083063+0000","last_peered":"2024-04-25T13:41:07.083063+0000","last_clean":"2024-04-25T13:41:07.083063+0000","last_became_active":"2024-04-25T13:41:04.417145+0000","last_became_peered":"2024-04-25T13:41:04.417145+0000","last_unstale":"2024-04-25T13:41:07.083063+0000","last_undegraded":"2024-04-25T13:41:07.083063+0000","last_fullsized":"2024-04-25T13:41:07.083063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082677+0000","last_change":"2024-04-25T13:41:04.417324+0000","last_active":"2024-04-25T13:41:07.082677+0000","last_peered":"2024-04-25T13:41:07.082677+0000","last_clean":"2024-04-25T13:41:07.082677+0000","last_became_active":"2024-04-25T13:41:04.416982+0000","last_became_peered":"2024-04-25T13:41:04.416982+0000","last_unstale":"2024-04-25T13:41:07.082677+0000","last_undegraded":"2024-04-25T13:41:07.082677+0000","last_fullsized":"2024-04-25T13:41:07.082677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084913+0000","last_change":"2024-04-25T13:41:04.412869+0000","last_active":"2024-04-25T13:41:07.084913+0000","last_peered":"2024-04-25T13:41:07.084913+0000","last_clean":"2024-04-25T13:41:07.084913+0000","last_became_active":"2024-04-25T13:41:04.412544+0000","last_became_peered":"2024-04-25T13:41:04.412544+0000","last_unstale":"2024-04-25T13:41:07.084913+0000","last_undegraded":"2024-04-25T13:41:07.084913+0000","last_fullsized":"2024-04-25T13:41:07.084913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272972+0000","last_change":"2024-04-25T13:41:04.412143+0000","last_active":"2024-04-25T13:41:06.272972+0000","last_peered":"2024-04-25T13:41:06.272972+0000","last_clean":"2024-04-25T13:41:06.272972+0000","last_became_active":"2024-04-25T13:41:04.411840+0000","last_became_peered":"2024-04-25T13:41:04.411840+0000","last_unstale":"2024-04-25T13:41:06.272972+0000","last_undegraded":"2024-04-25T13:41:06.272972+0000","last_fullsized":"2024-04-25T13:41:06.272972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080138+0000","last_change":"2024-04-25T13:41:04.426859+0000","last_active":"2024-04-25T13:41:07.080138+0000","last_peered":"2024-04-25T13:41:07.080138+0000","last_clean":"2024-04-25T13:41:07.080138+0000","last_became_active":"2024-04-25T13:41:04.426437+0000","last_became_peered":"2024-04-25T13:41:04.426437+0000","last_unstale":"2024-04-25T13:41:07.080138+0000","last_undegraded":"2024-04-25T13:41:07.080138+0000","last_fullsized":"2024-04-25T13:41:07.080138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:21.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394006+0000","last_change":"2024-04-25T13:41:04.410712+0000","last_active":"2024-04-25T13:41:05.394006+0000","last_peered":"2024-04-25T13:41:05.394006+0000","last_clean":"2024-04-25T13:41:05.394006+0000","last_became_active":"2024-04-25T13:41:04.410362+0000","last_became_peered":"2024-04-25T13:41:04.410362+0000","last_unstale":"2024-04-25T13:41:05.394006+0000","last_undegraded":"2024-04-25T13:41:05.394006+0000","last_fullsized":"2024-04-25T13:41:05.394006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397254+0000","last_change":"2024-04-25T13:41:04.429493+0000","last_active":"2024-04-25T13:41:05.397254+0000","last_peered":"2024-04-25T13:41:05.397254+0000","last_clean":"2024-04-25T13:41:05.397254+0000","last_became_active":"2024-04-25T13:41:04.429116+0000","last_became_peered":"2024-04-25T13:41:04.429116+0000","last_unstale":"2024-04-25T13:41:05.397254+0000","last_undegraded":"2024-04-25T13:41:05.397254+0000","last_fullsized":"2024-04-25T13:41:05.397254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399835+0000","last_change":"2024-04-25T13:41:04.431688+0000","last_active":"2024-04-25T13:41:05.399835+0000","last_peered":"2024-04-25T13:41:05.399835+0000","last_clean":"2024-04-25T13:41:05.399835+0000","last_became_active":"2024-04-25T13:41:04.431231+0000","last_became_peered":"2024-04-25T13:41:04.431231+0000","last_unstale":"2024-04-25T13:41:05.399835+0000","last_undegraded":"2024-04-25T13:41:05.399835+0000","last_fullsized":"2024-04-25T13:41:05.399835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390359+0000","last_change":"2024-04-25T13:41:04.407914+0000","last_active":"2024-04-25T13:41:05.390359+0000","last_peered":"2024-04-25T13:41:05.390359+0000","last_clean":"2024-04-25T13:41:05.390359+0000","last_became_active":"2024-04-25T13:41:04.407553+0000","last_became_peered":"2024-04-25T13:41:04.407553+0000","last_unstale":"2024-04-25T13:41:05.390359+0000","last_undegraded":"2024-04-25T13:41:05.390359+0000","last_fullsized":"2024-04-25T13:41:05.390359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376272+0000","last_change":"2024-04-25T13:41:04.430301+0000","last_active":"2024-04-25T13:41:06.376272+0000","last_peered":"2024-04-25T13:41:06.376272+0000","last_clean":"2024-04-25T13:41:06.376272+0000","last_became_active":"2024-04-25T13:41:04.428597+0000","last_became_peered":"2024-04-25T13:41:04.428597+0000","last_unstale":"2024-04-25T13:41:06.376272+0000","last_undegraded":"2024-04-25T13:41:06.376272+0000","last_fullsized":"2024-04-25T13:41:06.376272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082158+0000","last_change":"2024-04-25T13:41:04.423772+0000","last_active":"2024-04-25T13:41:07.082158+0000","last_peered":"2024-04-25T13:41:07.082158+0000","last_clean":"2024-04-25T13:41:07.082158+0000","last_became_active":"2024-04-25T13:41:04.423453+0000","last_became_peered":"2024-04-25T13:41:04.423453+0000","last_unstale":"2024-04-25T13:41:07.082158+0000","last_undegraded":"2024-04-25T13:41:07.082158+0000","last_fullsized":"2024-04-25T13:41:07.082158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080752+0000","last_change":"2024-04-25T13:41:04.430195+0000","last_active":"2024-04-25T13:41:07.080752+0000","last_peered":"2024-04-25T13:41:07.080752+0000","last_clean":"2024-04-25T13:41:07.080752+0000","last_became_active":"2024-04-25T13:41:04.429917+0000","last_became_peered":"2024-04-25T13:41:04.429917+0000","last_unstale":"2024-04-25T13:41:07.080752+0000","last_undegraded":"2024-04-25T13:41:07.080752+0000","last_fullsized":"2024-04-25T13:41:07.080752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398046+0000","last_change":"2024-04-25T13:41:04.431579+0000","last_active":"2024-04-25T13:41:05.398046+0000","last_peered":"2024-04-25T13:41:05.398046+0000","last_clean":"2024-04-25T13:41:05.398046+0000","last_became_active":"2024-04-25T13:41:04.431160+0000","last_became_peered":"2024-04-25T13:41:04.431160+0000","last_unstale":"2024-04-25T13:41:05.398046+0000","last_undegraded":"2024-04-25T13:41:05.398046+0000","last_fullsized":"2024-04-25T13:41:05.398046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271836+0000","last_change":"2024-04-25T13:41:04.423185+0000","last_active":"2024-04-25T13:41:06.271836+0000","last_peered":"2024-04-25T13:41:06.271836+0000","last_clean":"2024-04-25T13:41:06.271836+0000","last_became_active":"2024-04-25T13:41:04.422815+0000","last_became_peered":"2024-04-25T13:41:04.422815+0000","last_unstale":"2024-04-25T13:41:06.271836+0000","last_undegraded":"2024-04-25T13:41:06.271836+0000","last_fullsized":"2024-04-25T13:41:06.271836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397647+0000","last_change":"2024-04-25T13:41:04.415522+0000","last_active":"2024-04-25T13:41:05.397647+0000","last_peered":"2024-04-25T13:41:05.397647+0000","last_clean":"2024-04-25T13:41:05.397647+0000","last_became_active":"2024-04-25T13:41:04.414898+0000","last_became_peered":"2024-04-25T13:41:04.414898+0000","last_unstale":"2024-04-25T13:41:05.397647+0000","last_undegraded":"2024-04-25T13:41:05.397647+0000","last_fullsized":"2024-04-25T13:41:05.397647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272770+0000","last_change":"2024-04-25T13:41:04.422142+0000","last_active":"2024-04-25T13:41:06.272770+0000","last_peered":"2024-04-25T13:41:06.272770+0000","last_clean":"2024-04-25T13:41:06.272770+0000","last_became_active":"2024-04-25T13:41:04.421279+0000","last_became_peered":"2024-04-25T13:41:04.421279+0000","last_unstale":"2024-04-25T13:41:06.272770+0000","last_undegraded":"2024-04-25T13:41:06.272770+0000","last_fullsized":"2024-04-25T13:41:06.272770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083116+0000","last_change":"2024-04-25T13:41:04.431595+0000","last_active":"2024-04-25T13:41:07.083116+0000","last_peered":"2024-04-25T13:41:07.083116+0000","last_clean":"2024-04-25T13:41:07.083116+0000","last_became_active":"2024-04-25T13:41:04.431130+0000","last_became_peered":"2024-04-25T13:41:04.431130+0000","last_unstale":"2024-04-25T13:41:07.083116+0000","last_undegraded":"2024-04-25T13:41:07.083116+0000","last_fullsized":"2024-04-25T13:41:07.083116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394417+0000","last_change":"2024-04-25T13:41:04.413732+0000","last_active":"2024-04-25T13:41:05.394417+0000","last_peered":"2024-04-25T13:41:05.394417+0000","last_clean":"2024-04-25T13:41:05.394417+0000","last_became_active":"2024-04-25T13:41:04.413001+0000","last_became_peered":"2024-04-25T13:41:04.413001+0000","last_unstale":"2024-04-25T13:41:05.394417+0000","last_undegraded":"2024-04-25T13:41:05.394417+0000","last_fullsized":"2024-04-25T13:41:05.394417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272664+0000","last_change":"2024-04-25T13:41:04.421963+0000","last_active":"2024-04-25T13:41:06.272664+0000","last_peered":"2024-04-25T13:41:06.272664+0000","last_clean":"2024-04-25T13:41:06.272664+0000","last_became_active":"2024-04-25T13:41:04.421439+0000","last_became_peered":"2024-04-25T13:41:04.421439+0000","last_unstale":"2024-04-25T13:41:06.272664+0000","last_undegraded":"2024-04-25T13:41:06.272664+0000","last_fullsized":"2024-04-25T13:41:06.272664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080989+0000","last_change":"2024-04-25T13:41:04.423204+0000","last_active":"2024-04-25T13:41:07.080989+0000","last_peered":"2024-04-25T13:41:07.080989+0000","last_clean":"2024-04-25T13:41:07.080989+0000","last_became_active":"2024-04-25T13:41:04.422855+0000","last_became_peered":"2024-04-25T13:41:04.422855+0000","last_unstale":"2024-04-25T13:41:07.080989+0000","last_undegraded":"2024-04-25T13:41:07.080989+0000","last_fullsized":"2024-04-25T13:41:07.080989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398240+0000","last_change":"2024-04-25T13:41:04.416506+0000","last_active":"2024-04-25T13:41:05.398240+0000","last_peered":"2024-04-25T13:41:05.398240+0000","last_clean":"2024-04-25T13:41:05.398240+0000","last_became_active":"2024-04-25T13:41:04.416177+0000","last_became_peered":"2024-04-25T13:41:04.416177+0000","last_unstale":"2024-04-25T13:41:05.398240+0000","last_undegraded":"2024-04-25T13:41:05.398240+0000","last_fullsized":"2024-04-25T13:41:05.398240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390077+0000","last_change":"2024-04-25T13:41:04.414817+0000","last_active":"2024-04-25T13:41:05.390077+0000","last_peered":"2024-04-25T13:41:05.390077+0000","last_clean":"2024-04-25T13:41:05.390077+0000","last_became_active":"2024-04-25T13:41:04.414178+0000","last_became_peered":"2024-04-25T13:41:04.414178+0000","last_unstale":"2024-04-25T13:41:05.390077+0000","last_undegraded":"2024-04-25T13:41:05.390077+0000","last_fullsized":"2024-04-25T13:41:05.390077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081720+0000","last_change":"2024-04-25T13:41:04.430078+0000","last_active":"2024-04-25T13:41:07.081720+0000","last_peered":"2024-04-25T13:41:07.081720+0000","last_clean":"2024-04-25T13:41:07.081720+0000","last_became_active":"2024-04-25T13:41:04.429518+0000","last_became_peered":"2024-04-25T13:41:04.429518+0000","last_unstale":"2024-04-25T13:41:07.081720+0000","last_undegraded":"2024-04-25T13:41:07.081720+0000","last_fullsized":"2024-04-25T13:41:07.081720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084010+0000","last_change":"2024-04-25T13:41:04.402158+0000","last_active":"2024-04-25T13:41:07.084010+0000","last_peered":"2024-04-25T13:41:07.084010+0000","last_clean":"2024-04-25T13:41:07.084010+0000","last_became_active":"2024-04-25T13:41:04.401821+0000","last_became_peered":"2024-04-25T13:41:04.401821+0000","last_unstale":"2024-04-25T13:41:07.084010+0000","last_undegraded":"2024-04-25T13:41:07.084010+0000","last_fullsized":"2024-04-25T13:41:07.084010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:18.457935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272477+0000","last_change":"2024-04-25T13:41:03.425690+0000","last_active":"2024-04-25T13:41:06.272477+0000","last_peered":"2024-04-25T13:41:06.272477+0000","last_clean":"2024-04-25T13:41:06.272477+0000","last_became_active":"2024-04-25T13:41:03.425239+0000","last_became_peered":"2024-04-25T13:41:03.425239+0000","last_unstale":"2024-04-25T13:41:06.272477+0000","last_undegraded":"2024-04-25T13:41:06.272477+0000","last_fullsized":"2024-04-25T13:41:06.272477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081045+0000","last_change":"2024-04-25T13:41:04.411250+0000","last_active":"2024-04-25T13:41:07.081045+0000","last_peered":"2024-04-25T13:41:07.081045+0000","last_clean":"2024-04-25T13:41:07.081045+0000","last_became_active":"2024-04-25T13:41:04.400223+0000","last_became_peered":"2024-04-25T13:41:04.400223+0000","last_unstale":"2024-04-25T13:41:07.081045+0000","last_undegraded":"2024-04-25T13:41:07.081045+0000","last_fullsized":"2024-04-25T13:41:07.081045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081971+0000","last_change":"2024-04-25T13:41:03.435467+0000","last_active":"2024-04-25T13:41:07.081971+0000","last_peered":"2024-04-25T13:41:07.081971+0000","last_clean":"2024-04-25T13:41:07.081971+0000","last_became_active":"2024-04-25T13:41:03.426677+0000","last_became_peered":"2024-04-25T13:41:03.426677+0000","last_unstale":"2024-04-25T13:41:07.081971+0000","last_undegraded":"2024-04-25T13:41:07.081971+0000","last_fullsized":"2024-04-25T13:41:07.081971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271566+0000","last_change":"2024-04-25T13:41:03.437180+0000","last_active":"2024-04-25T13:41:06.271566+0000","last_peered":"2024-04-25T13:41:06.271566+0000","last_clean":"2024-04-25T13:41:06.271566+0000","last_became_active":"2024-04-25T13:41:03.436905+0000","last_became_peered":"2024-04-25T13:41:03.436905+0000","last_unstale":"2024-04-25T13:41:06.271566+0000","last_undegraded":"2024-04-25T13:41:06.271566+0000","last_fullsized":"2024-04-25T13:41:06.271566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271768+0000","last_change":"2024-04-25T13:41:04.423777+0000","last_active":"2024-04-25T13:41:06.271768+0000","last_peered":"2024-04-25T13:41:06.271768+0000","last_clean":"2024-04-25T13:41:06.271768+0000","last_became_active":"2024-04-25T13:41:04.423470+0000","last_became_peered":"2024-04-25T13:41:04.423470+0000","last_unstale":"2024-04-25T13:41:06.271768+0000","last_undegraded":"2024-04-25T13:41:06.271768+0000","last_fullsized":"2024-04-25T13:41:06.271768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397437+0000","last_change":"2024-04-25T13:41:03.445205+0000","last_active":"2024-04-25T13:41:05.397437+0000","last_peered":"2024-04-25T13:41:05.397437+0000","last_clean":"2024-04-25T13:41:05.397437+0000","last_became_active":"2024-04-25T13:41:03.444412+0000","last_became_peered":"2024-04-25T13:41:03.444412+0000","last_unstale":"2024-04-25T13:41:05.397437+0000","last_undegraded":"2024-04-25T13:41:05.397437+0000","last_fullsized":"2024-04-25T13:41:05.397437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.393826+0000","last_change":"2024-04-25T13:41:04.413827+0000","last_active":"2024-04-25T13:41:05.393826+0000","last_peered":"2024-04-25T13:41:05.393826+0000","last_clean":"2024-04-25T13:41:05.393826+0000","last_became_active":"2024-04-25T13:41:04.413496+0000","last_became_peered":"2024-04-25T13:41:04.413496+0000","last_unstale":"2024-04-25T13:41:05.393826+0000","last_undegraded":"2024-04-25T13:41:05.393826+0000","last_fullsized":"2024-04-25T13:41:05.393826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082917+0000","last_change":"2024-04-25T13:41:03.450428+0000","last_active":"2024-04-25T13:41:07.082917+0000","last_peered":"2024-04-25T13:41:07.082917+0000","last_clean":"2024-04-25T13:41:07.082917+0000","last_became_active":"2024-04-25T13:41:03.449629+0000","last_became_peered":"2024-04-25T13:41:03.449629+0000","last_unstale":"2024-04-25T13:41:07.082917+0000","last_undegraded":"2024-04-25T13:41:07.082917+0000","last_fullsized":"2024-04-25T13:41:07.082917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399527+0000","last_change":"2024-04-25T13:41:04.431979+0000","last_active":"2024-04-25T13:41:05.399527+0000","last_peered":"2024-04-25T13:41:05.399527+0000","last_clean":"2024-04-25T13:41:05.399527+0000","last_became_active":"2024-04-25T13:41:04.431218+0000","last_became_peered":"2024-04-25T13:41:04.431218+0000","last_unstale":"2024-04-25T13:41:05.399527+0000","last_undegraded":"2024-04-25T13:41:05.399527+0000","last_fullsized":"2024-04-25T13:41:05.399527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399630+0000","last_change":"2024-04-25T13:41:03.445209+0000","last_active":"2024-04-25T13:41:05.399630+0000","last_peered":"2024-04-25T13:41:05.399630+0000","last_clean":"2024-04-25T13:41:05.399630+0000","last_became_active":"2024-04-25T13:41:03.444460+0000","last_became_peered":"2024-04-25T13:41:03.444460+0000","last_unstale":"2024-04-25T13:41:05.399630+0000","last_undegraded":"2024-04-25T13:41:05.399630+0000","last_fullsized":"2024-04-25T13:41:05.399630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080960+0000","last_change":"2024-04-25T13:41:04.423661+0000","last_active":"2024-04-25T13:41:07.080960+0000","last_peered":"2024-04-25T13:41:07.080960+0000","last_clean":"2024-04-25T13:41:07.080960+0000","last_became_active":"2024-04-25T13:41:04.421991+0000","last_became_peered":"2024-04-25T13:41:04.421991+0000","last_unstale":"2024-04-25T13:41:07.080960+0000","last_undegraded":"2024-04-25T13:41:07.080960+0000","last_fullsized":"2024-04-25T13:41:07.080960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394142+0000","last_change":"2024-04-25T13:41:03.443960+0000","last_active":"2024-04-25T13:41:05.394142+0000","last_peered":"2024-04-25T13:41:05.394142+0000","last_clean":"2024-04-25T13:41:05.394142+0000","last_became_active":"2024-04-25T13:41:03.443721+0000","last_became_peered":"2024-04-25T13:41:03.443721+0000","last_unstale":"2024-04-25T13:41:05.394142+0000","last_undegraded":"2024-04-25T13:41:05.394142+0000","last_fullsized":"2024-04-25T13:41:05.394142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.085160+0000","last_change":"2024-04-25T13:41:04.423896+0000","last_active":"2024-04-25T13:41:07.085160+0000","last_peered":"2024-04-25T13:41:07.085160+0000","last_clean":"2024-04-25T13:41:07.085160+0000","last_became_active":"2024-04-25T13:41:04.423569+0000","last_became_peered":"2024-04-25T13:41:04.423569+0000","last_unstale":"2024-04-25T13:41:07.085160+0000","last_undegraded":"2024-04-25T13:41:07.085160+0000","last_fullsized":"2024-04-25T13:41:07.085160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081924+0000","last_change":"2024-04-25T13:41:03.426055+0000","last_active":"2024-04-25T13:41:07.081924+0000","last_peered":"2024-04-25T13:41:07.081924+0000","last_clean":"2024-04-25T13:41:07.081924+0000","last_became_active":"2024-04-25T13:41:03.424990+0000","last_became_peered":"2024-04-25T13:41:03.424990+0000","last_unstale":"2024-04-25T13:41:07.081924+0000","last_undegraded":"2024-04-25T13:41:07.081924+0000","last_fullsized":"2024-04-25T13:41:07.081924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375890+0000","last_change":"2024-04-25T13:41:04.430564+0000","last_active":"2024-04-25T13:41:06.375890+0000","last_peered":"2024-04-25T13:41:06.375890+0000","last_clean":"2024-04-25T13:41:06.375890+0000","last_became_active":"2024-04-25T13:41:04.427802+0000","last_became_peered":"2024-04-25T13:41:04.427802+0000","last_unstale":"2024-04-25T13:41:06.375890+0000","last_undegraded":"2024-04-25T13:41:06.375890+0000","last_fullsized":"2024-04-25T13:41:06.375890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081161+0000","last_change":"2024-04-25T13:41:03.422851+0000","last_active":"2024-04-25T13:41:07.081161+0000","last_peered":"2024-04-25T13:41:07.081161+0000","last_clean":"2024-04-25T13:41:07.081161+0000","last_became_active":"2024-04-25T13:41:03.422529+0000","last_became_peered":"2024-04-25T13:41:03.422529+0000","last_unstale":"2024-04-25T13:41:07.081161+0000","last_undegraded":"2024-04-25T13:41:07.081161+0000","last_fullsized":"2024-04-25T13:41:07.081161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080588+0000","last_change":"2024-04-25T13:41:04.429077+0000","last_active":"2024-04-25T13:41:07.080588+0000","last_peered":"2024-04-25T13:41:07.080588+0000","last_clean":"2024-04-25T13:41:07.080588+0000","last_became_active":"2024-04-25T13:41:04.428641+0000","last_became_peered":"2024-04-25T13:41:04.428641+0000","last_unstale":"2024-04-25T13:41:07.080588+0000","last_undegraded":"2024-04-25T13:41:07.080588+0000","last_fullsized":"2024-04-25T13:41:07.080588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398137+0000","last_change":"2024-04-25T13:41:03.450649+0000","last_active":"2024-04-25T13:41:05.398137+0000","last_peered":"2024-04-25T13:41:05.398137+0000","last_clean":"2024-04-25T13:41:05.398137+0000","last_became_active":"2024-04-25T13:41:03.449872+0000","last_became_peered":"2024-04-25T13:41:03.449872+0000","last_unstale":"2024-04-25T13:41:05.398137+0000","last_undegraded":"2024-04-25T13:41:05.398137+0000","last_fullsized":"2024-04-25T13:41:05.398137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375589+0000","last_change":"2024-04-25T13:41:04.434947+0000","last_active":"2024-04-25T13:41:06.375589+0000","last_peered":"2024-04-25T13:41:06.375589+0000","last_clean":"2024-04-25T13:41:06.375589+0000","last_became_active":"2024-04-25T13:41:04.434502+0000","last_became_peered":"2024-04-25T13:41:04.434502+0000","last_unstale":"2024-04-25T13:41:06.375589+0000","last_undegraded":"2024-04-25T13:41:06.375589+0000","last_fullsized":"2024-04-25T13:41:06.375589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081461+0000","last_change":"2024-04-25T13:41:03.423826+0000","last_active":"2024-04-25T13:41:07.081461+0000","last_peered":"2024-04-25T13:41:07.081461+0000","last_clean":"2024-04-25T13:41:07.081461+0000","last_became_active":"2024-04-25T13:41:03.423037+0000","last_became_peered":"2024-04-25T13:41:03.423037+0000","last_unstale":"2024-04-25T13:41:07.081461+0000","last_undegraded":"2024-04-25T13:41:07.081461+0000","last_fullsized":"2024-04-25T13:41:07.081461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081702+0000","last_change":"2024-04-25T13:41:04.429831+0000","last_active":"2024-04-25T13:41:07.081702+0000","last_peered":"2024-04-25T13:41:07.081702+0000","last_clean":"2024-04-25T13:41:07.081702+0000","last_became_active":"2024-04-25T13:41:04.429110+0000","last_became_peered":"2024-04-25T13:41:04.429110+0000","last_unstale":"2024-04-25T13:41:07.081702+0000","last_undegraded":"2024-04-25T13:41:07.081702+0000","last_fullsized":"2024-04-25T13:41:07.081702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.389771+0000","last_change":"2024-04-25T13:41:03.409148+0000","last_active":"2024-04-25T13:41:05.389771+0000","last_peered":"2024-04-25T13:41:05.389771+0000","last_clean":"2024-04-25T13:41:05.389771+0000","last_became_active":"2024-04-25T13:41:03.408414+0000","last_became_peered":"2024-04-25T13:41:03.408414+0000","last_unstale":"2024-04-25T13:41:05.389771+0000","last_undegraded":"2024-04-25T13:41:05.389771+0000","last_fullsized":"2024-04-25T13:41:05.389771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375388+0000","last_change":"2024-04-25T13:41:04.426477+0000","last_active":"2024-04-25T13:41:06.375388+0000","last_peered":"2024-04-25T13:41:06.375388+0000","last_clean":"2024-04-25T13:41:06.375388+0000","last_became_active":"2024-04-25T13:41:04.425891+0000","last_became_peered":"2024-04-25T13:41:04.425891+0000","last_unstale":"2024-04-25T13:41:06.375388+0000","last_undegraded":"2024-04-25T13:41:06.375388+0000","last_fullsized":"2024-04-25T13:41:06.375388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084806+0000","last_change":"2024-04-25T13:41:03.421716+0000","last_active":"2024-04-25T13:41:07.084806+0000","last_peered":"2024-04-25T13:41:07.084806+0000","last_clean":"2024-04-25T13:41:07.084806+0000","last_became_active":"2024-04-25T13:41:03.420848+0000","last_became_peered":"2024-04-25T13:41:03.420848+0000","last_unstale":"2024-04-25T13:41:07.084806+0000","last_undegraded":"2024-04-25T13:41:07.084806+0000","last_fullsized":"2024-04-25T13:41:07.084806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.389116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376433+0000","last_change":"2024-04-25T13:41:04.429840+0000","last_active":"2024-04-25T13:41:06.376433+0000","last_peered":"2024-04-25T13:41:06.376433+0000","last_clean":"2024-04-25T13:41:06.376433+0000","last_became_active":"2024-04-25T13:41:04.429404+0000","last_became_peered":"2024-04-25T13:41:04.429404+0000","last_unstale":"2024-04-25T13:41:06.376433+0000","last_undegraded":"2024-04-25T13:41:06.376433+0000","last_fullsized":"2024-04-25T13:41:06.376433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390507+0000","last_change":"2024-04-25T13:41:03.415723+0000","last_active":"2024-04-25T13:41:05.390507+0000","last_peered":"2024-04-25T13:41:05.390507+0000","last_clean":"2024-04-25T13:41:05.390507+0000","last_became_active":"2024-04-25T13:41:03.414957+0000","last_became_peered":"2024-04-25T13:41:03.414957+0000","last_unstale":"2024-04-25T13:41:05.390507+0000","last_undegraded":"2024-04-25T13:41:05.390507+0000","last_fullsized":"2024-04-25T13:41:05.390507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376788+0000","last_change":"2024-04-25T13:41:04.434675+0000","last_active":"2024-04-25T13:41:06.376788+0000","last_peered":"2024-04-25T13:41:06.376788+0000","last_clean":"2024-04-25T13:41:06.376788+0000","last_became_active":"2024-04-25T13:41:04.434194+0000","last_became_peered":"2024-04-25T13:41:04.434194+0000","last_unstale":"2024-04-25T13:41:06.376788+0000","last_undegraded":"2024-04-25T13:41:06.376788+0000","last_fullsized":"2024-04-25T13:41:06.376788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394277+0000","last_change":"2024-04-25T13:41:03.402131+0000","last_active":"2024-04-25T13:41:05.394277+0000","last_peered":"2024-04-25T13:41:05.394277+0000","last_clean":"2024-04-25T13:41:05.394277+0000","last_became_active":"2024-04-25T13:41:03.401398+0000","last_became_peered":"2024-04-25T13:41:03.401398+0000","last_unstale":"2024-04-25T13:41:05.394277+0000","last_undegraded":"2024-04-25T13:41:05.394277+0000","last_fullsized":"2024-04-25T13:41:05.394277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398944+0000","last_change":"2024-04-25T13:41:04.418743+0000","last_active":"2024-04-25T13:41:05.398944+0000","last_peered":"2024-04-25T13:41:05.398944+0000","last_clean":"2024-04-25T13:41:05.398944+0000","last_became_active":"2024-04-25T13:41:04.417963+0000","last_became_peered":"2024-04-25T13:41:04.417963+0000","last_unstale":"2024-04-25T13:41:05.398944+0000","last_undegraded":"2024-04-25T13:41:05.398944+0000","last_fullsized":"2024-04-25T13:41:05.398944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390275+0000","last_change":"2024-04-25T13:41:03.445729+0000","last_active":"2024-04-25T13:41:05.390275+0000","last_peered":"2024-04-25T13:41:05.390275+0000","last_clean":"2024-04-25T13:41:05.390275+0000","last_became_active":"2024-04-25T13:41:03.445293+0000","last_became_peered":"2024-04-25T13:41:03.445293+0000","last_unstale":"2024-04-25T13:41:05.390275+0000","last_undegraded":"2024-04-25T13:41:05.390275+0000","last_fullsized":"2024-04-25T13:41:05.390275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375956+0000","last_change":"2024-04-25T13:41:04.429996+0000","last_active":"2024-04-25T13:41:06.375956+0000","last_peered":"2024-04-25T13:41:06.375956+0000","last_clean":"2024-04-25T13:41:06.375956+0000","last_became_active":"2024-04-25T13:41:04.428232+0000","last_became_peered":"2024-04-25T13:41:04.428232+0000","last_unstale":"2024-04-25T13:41:06.375956+0000","last_undegraded":"2024-04-25T13:41:06.375956+0000","last_fullsized":"2024-04-25T13:41:06.375956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375088+0000","last_change":"2024-04-25T13:41:00.175142+0000","last_active":"2024-04-25T13:41:06.375088+0000","last_peered":"2024-04-25T13:41:06.375088+0000","last_clean":"2024-04-25T13:41:06.375088+0000","last_became_active":"2024-04-25T13:41:00.172906+0000","last_became_peered":"2024-04-25T13:41:00.172906+0000","last_unstale":"2024-04-25T13:41:06.375088+0000","last_undegraded":"2024-04-25T13:41:06.375088+0000","last_fullsized":"2024-04-25T13:41:06.375088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_clean_scrub_stamp":"2024-04-25T13:40:59.093070+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:38.020124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397151+0000","last_change":"2024-04-25T13:41:03.438420+0000","last_active":"2024-04-25T13:41:05.397151+0000","last_peered":"2024-04-25T13:41:05.397151+0000","last_clean":"2024-04-25T13:41:05.397151+0000","last_became_active":"2024-04-25T13:41:03.437569+0000","last_became_peered":"2024-04-25T13:41:03.437569+0000","last_unstale":"2024-04-25T13:41:05.397151+0000","last_undegraded":"2024-04-25T13:41:05.397151+0000","last_fullsized":"2024-04-25T13:41:05.397151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272317+0000","last_change":"2024-04-25T13:41:04.417328+0000","last_active":"2024-04-25T13:41:06.272317+0000","last_peered":"2024-04-25T13:41:06.272317+0000","last_clean":"2024-04-25T13:41:06.272317+0000","last_became_active":"2024-04-25T13:41:04.416666+0000","last_became_peered":"2024-04-25T13:41:04.416666+0000","last_unstale":"2024-04-25T13:41:06.272317+0000","last_undegraded":"2024-04-25T13:41:06.272317+0000","last_fullsized":"2024-04-25T13:41:06.272317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.374736+0000","last_change":"2024-04-25T13:41:03.431855+0000","last_active":"2024-04-25T13:41:06.374736+0000","last_peered":"2024-04-25T13:41:06.374736+0000","last_clean":"2024-04-25T13:41:06.374736+0000","last_became_active":"2024-04-25T13:41:03.429200+0000","last_became_peered":"2024-04-25T13:41:03.429200+0000","last_unstale":"2024-04-25T13:41:06.374736+0000","last_undegraded":"2024-04-25T13:41:06.374736+0000","last_fullsized":"2024-04-25T13:41:06.374736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080267+0000","last_change":"2024-04-25T13:41:04.411548+0000","last_active":"2024-04-25T13:41:07.080267+0000","last_peered":"2024-04-25T13:41:07.080267+0000","last_clean":"2024-04-25T13:41:07.080267+0000","last_became_active":"2024-04-25T13:41:04.400093+0000","last_became_peered":"2024-04-25T13:41:04.400093+0000","last_unstale":"2024-04-25T13:41:07.080267+0000","last_undegraded":"2024-04-25T13:41:07.080267+0000","last_fullsized":"2024-04-25T13:41:07.080267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:09.999429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390174+0000","last_change":"2024-04-25T13:41:03.415949+0000","last_active":"2024-04-25T13:41:05.390174+0000","last_peered":"2024-04-25T13:41:05.390174+0000","last_clean":"2024-04-25T13:41:05.390174+0000","last_became_active":"2024-04-25T13:41:03.414899+0000","last_became_peered":"2024-04-25T13:41:03.414899+0000","last_unstale":"2024-04-25T13:41:05.390174+0000","last_undegraded":"2024-04-25T13:41:05.390174+0000","last_fullsized":"2024-04-25T13:41:05.390174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394211+0000","last_change":"2024-04-25T13:41:04.403032+0000","last_active":"2024-04-25T13:41:05.394211+0000","last_peered":"2024-04-25T13:41:05.394211+0000","last_clean":"2024-04-25T13:41:05.394211+0000","last_became_active":"2024-04-25T13:41:04.402055+0000","last_became_peered":"2024-04-25T13:41:04.402055+0000","last_unstale":"2024-04-25T13:41:05.394211+0000","last_undegraded":"2024-04-25T13:41:05.394211+0000","last_fullsized":"2024-04-25T13:41:05.394211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398292+0000","last_change":"2024-04-25T13:41:03.447547+0000","last_active":"2024-04-25T13:41:05.398292+0000","last_peered":"2024-04-25T13:41:05.398292+0000","last_clean":"2024-04-25T13:41:05.398292+0000","last_became_active":"2024-04-25T13:41:03.444429+0000","last_became_peered":"2024-04-25T13:41:03.444429+0000","last_unstale":"2024-04-25T13:41:05.398292+0000","last_undegraded":"2024-04-25T13:41:05.398292+0000","last_fullsized":"2024-04-25T13:41:05.398292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084597+0000","last_change":"2024-04-25T13:41:04.398647+0000","last_active":"2024-04-25T13:41:07.084597+0000","last_peered":"2024-04-25T13:41:07.084597+0000","last_clean":"2024-04-25T13:41:07.084597+0000","last_became_active":"2024-04-25T13:41:04.398287+0000","last_became_peered":"2024-04-25T13:41:04.398287+0000","last_unstale":"2024-04-25T13:41:07.084597+0000","last_undegraded":"2024-04-25T13:41:07.084597+0000","last_fullsized":"2024-04-25T13:41:07.084597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:06.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394703+0000","last_change":"2024-04-25T13:41:03.414535+0000","last_active":"2024-04-25T13:41:05.394703+0000","last_peered":"2024-04-25T13:41:05.394703+0000","last_clean":"2024-04-25T13:41:05.394703+0000","last_became_active":"2024-04-25T13:41:03.414145+0000","last_became_peered":"2024-04-25T13:41:03.414145+0000","last_unstale":"2024-04-25T13:41:05.394703+0000","last_undegraded":"2024-04-25T13:41:05.394703+0000","last_fullsized":"2024-04-25T13:41:05.394703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399648+0000","last_change":"2024-04-25T13:41:04.419186+0000","last_active":"2024-04-25T13:41:05.399648+0000","last_peered":"2024-04-25T13:41:05.399648+0000","last_clean":"2024-04-25T13:41:05.399648+0000","last_became_active":"2024-04-25T13:41:04.417831+0000","last_became_peered":"2024-04-25T13:41:04.417831+0000","last_unstale":"2024-04-25T13:41:05.399648+0000","last_undegraded":"2024-04-25T13:41:05.399648+0000","last_fullsized":"2024-04-25T13:41:05.399648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376400+0000","last_change":"2024-04-25T13:41:03.424206+0000","last_active":"2024-04-25T13:41:06.376400+0000","last_peered":"2024-04-25T13:41:06.376400+0000","last_clean":"2024-04-25T13:41:06.376400+0000","last_became_active":"2024-04-25T13:41:03.423176+0000","last_became_peered":"2024-04-25T13:41:03.423176+0000","last_unstale":"2024-04-25T13:41:06.376400+0000","last_undegraded":"2024-04-25T13:41:06.376400+0000","last_fullsized":"2024-04-25T13:41:06.376400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:23.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394828+0000","last_change":"2024-04-25T13:41:04.402353+0000","last_active":"2024-04-25T13:41:05.394828+0000","last_peered":"2024-04-25T13:41:05.394828+0000","last_clean":"2024-04-25T13:41:05.394828+0000","last_became_active":"2024-04-25T13:41:04.402014+0000","last_became_peered":"2024-04-25T13:41:04.402014+0000","last_unstale":"2024-04-25T13:41:05.394828+0000","last_undegraded":"2024-04-25T13:41:05.394828+0000","last_fullsized":"2024-04-25T13:41:05.394828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394770+0000","last_change":"2024-04-25T13:41:03.439449+0000","last_active":"2024-04-25T13:41:05.394770+0000","last_peered":"2024-04-25T13:41:05.394770+0000","last_clean":"2024-04-25T13:41:05.394770+0000","last_became_active":"2024-04-25T13:41:03.439074+0000","last_became_peered":"2024-04-25T13:41:03.439074+0000","last_unstale":"2024-04-25T13:41:05.394770+0000","last_undegraded":"2024-04-25T13:41:05.394770+0000","last_fullsized":"2024-04-25T13:41:05.394770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272770+0000","last_change":"2024-04-25T13:41:04.418630+0000","last_active":"2024-04-25T13:41:06.272770+0000","last_peered":"2024-04-25T13:41:06.272770+0000","last_clean":"2024-04-25T13:41:06.272770+0000","last_became_active":"2024-04-25T13:41:04.418330+0000","last_became_peered":"2024-04-25T13:41:04.418330+0000","last_unstale":"2024-04-25T13:41:06.272770+0000","last_undegraded":"2024-04-25T13:41:06.272770+0000","last_fullsized":"2024-04-25T13:41:06.272770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083247+0000","last_change":"2024-04-25T13:41:03.435851+0000","last_active":"2024-04-25T13:41:07.083247+0000","last_peered":"2024-04-25T13:41:07.083247+0000","last_clean":"2024-04-25T13:41:07.083247+0000","last_became_active":"2024-04-25T13:41:03.434870+0000","last_became_peered":"2024-04-25T13:41:03.434870+0000","last_unstale":"2024-04-25T13:41:07.083247+0000","last_undegraded":"2024-04-25T13:41:07.083247+0000","last_fullsized":"2024-04-25T13:41:07.083247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080993+0000","last_change":"2024-04-25T13:41:04.426962+0000","last_active":"2024-04-25T13:41:07.080993+0000","last_peered":"2024-04-25T13:41:07.080993+0000","last_clean":"2024-04-25T13:41:07.080993+0000","last_became_active":"2024-04-25T13:41:04.426424+0000","last_became_peered":"2024-04-25T13:41:04.426424+0000","last_unstale":"2024-04-25T13:41:07.080993+0000","last_undegraded":"2024-04-25T13:41:07.080993+0000","last_fullsized":"2024-04-25T13:41:07.080993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.374720+0000","last_change":"2024-04-25T13:41:03.430095+0000","last_active":"2024-04-25T13:41:06.374720+0000","last_peered":"2024-04-25T13:41:06.374720+0000","last_clean":"2024-04-25T13:41:06.374720+0000","last_became_active":"2024-04-25T13:41:03.429094+0000","last_became_peered":"2024-04-25T13:41:03.429094+0000","last_unstale":"2024-04-25T13:41:06.374720+0000","last_undegraded":"2024-04-25T13:41:06.374720+0000","last_fullsized":"2024-04-25T13:41:06.374720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083934+0000","last_change":"2024-04-25T13:41:04.413097+0000","last_active":"2024-04-25T13:41:07.083934+0000","last_peered":"2024-04-25T13:41:07.083934+0000","last_clean":"2024-04-25T13:41:07.083934+0000","last_became_active":"2024-04-25T13:41:04.412572+0000","last_became_peered":"2024-04-25T13:41:04.412572+0000","last_unstale":"2024-04-25T13:41:07.083934+0000","last_undegraded":"2024-04-25T13:41:07.083934+0000","last_fullsized":"2024-04-25T13:41:07.083934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:50.740570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394078+0000","last_change":"2024-04-25T13:41:03.411890+0000","last_active":"2024-04-25T13:41:05.394078+0000","last_peered":"2024-04-25T13:41:05.394078+0000","last_clean":"2024-04-25T13:41:05.394078+0000","last_became_active":"2024-04-25T13:41:03.411481+0000","last_became_peered":"2024-04-25T13:41:03.411481+0000","last_unstale":"2024-04-25T13:41:05.394078+0000","last_undegraded":"2024-04-25T13:41:05.394078+0000","last_fullsized":"2024-04-25T13:41:05.394078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272095+0000","last_change":"2024-04-25T13:41:04.408896+0000","last_active":"2024-04-25T13:41:06.272095+0000","last_peered":"2024-04-25T13:41:06.272095+0000","last_clean":"2024-04-25T13:41:06.272095+0000","last_became_active":"2024-04-25T13:41:04.408517+0000","last_became_peered":"2024-04-25T13:41:04.408517+0000","last_unstale":"2024-04-25T13:41:06.272095+0000","last_undegraded":"2024-04-25T13:41:06.272095+0000","last_fullsized":"2024-04-25T13:41:06.272095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394550+0000","last_change":"2024-04-25T13:41:03.408129+0000","last_active":"2024-04-25T13:41:05.394550+0000","last_peered":"2024-04-25T13:41:05.394550+0000","last_clean":"2024-04-25T13:41:05.394550+0000","last_became_active":"2024-04-25T13:41:03.407713+0000","last_became_peered":"2024-04-25T13:41:03.407713+0000","last_unstale":"2024-04-25T13:41:05.394550+0000","last_undegraded":"2024-04-25T13:41:05.394550+0000","last_fullsized":"2024-04-25T13:41:05.394550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272097+0000","last_change":"2024-04-25T13:41:04.424601+0000","last_active":"2024-04-25T13:41:06.272097+0000","last_peered":"2024-04-25T13:41:06.272097+0000","last_clean":"2024-04-25T13:41:06.272097+0000","last_became_active":"2024-04-25T13:41:04.424153+0000","last_became_peered":"2024-04-25T13:41:04.424153+0000","last_unstale":"2024-04-25T13:41:06.272097+0000","last_undegraded":"2024-04-25T13:41:06.272097+0000","last_fullsized":"2024-04-25T13:41:06.272097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375586+0000","last_change":"2024-04-25T13:41:03.431525+0000","last_active":"2024-04-25T13:41:06.375586+0000","last_peered":"2024-04-25T13:41:06.375586+0000","last_clean":"2024-04-25T13:41:06.375586+0000","last_became_active":"2024-04-25T13:41:03.430716+0000","last_became_peered":"2024-04-25T13:41:03.430716+0000","last_unstale":"2024-04-25T13:41:06.375586+0000","last_undegraded":"2024-04-25T13:41:06.375586+0000","last_fullsized":"2024-04-25T13:41:06.375586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:46.480379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081813+0000","last_change":"2024-04-25T13:41:04.424614+0000","last_active":"2024-04-25T13:41:07.081813+0000","last_peered":"2024-04-25T13:41:07.081813+0000","last_clean":"2024-04-25T13:41:07.081813+0000","last_became_active":"2024-04-25T13:41:04.424248+0000","last_became_peered":"2024-04-25T13:41:04.424248+0000","last_unstale":"2024-04-25T13:41:07.081813+0000","last_undegraded":"2024-04-25T13:41:07.081813+0000","last_fullsized":"2024-04-25T13:41:07.081813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399200+0000","last_change":"2024-04-25T13:41:04.425893+0000","last_active":"2024-04-25T13:41:05.399200+0000","last_peered":"2024-04-25T13:41:05.399200+0000","last_clean":"2024-04-25T13:41:05.399200+0000","last_became_active":"2024-04-25T13:41:04.424475+0000","last_became_peered":"2024-04-25T13:41:04.424475+0000","last_unstale":"2024-04-25T13:41:05.399200+0000","last_undegraded":"2024-04-25T13:41:05.399200+0000","last_fullsized":"2024-04-25T13:41:05.399200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375539+0000","last_change":"2024-04-25T13:41:03.447296+0000","last_active":"2024-04-25T13:41:06.375539+0000","last_peered":"2024-04-25T13:41:06.375539+0000","last_clean":"2024-04-25T13:41:06.375539+0000","last_became_active":"2024-04-25T13:41:03.446522+0000","last_became_peered":"2024-04-25T13:41:03.446522+0000","last_unstale":"2024-04-25T13:41:06.375539+0000","last_undegraded":"2024-04-25T13:41:06.375539+0000","last_fullsized":"2024-04-25T13:41:06.375539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398474+0000","last_change":"2024-04-25T13:41:04.424211+0000","last_active":"2024-04-25T13:41:05.398474+0000","last_peered":"2024-04-25T13:41:05.398474+0000","last_clean":"2024-04-25T13:41:05.398474+0000","last_became_active":"2024-04-25T13:41:04.423899+0000","last_became_peered":"2024-04-25T13:41:04.423899+0000","last_unstale":"2024-04-25T13:41:05.398474+0000","last_undegraded":"2024-04-25T13:41:05.398474+0000","last_fullsized":"2024-04-25T13:41:05.398474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376048+0000","last_change":"2024-04-25T13:41:03.441717+0000","last_active":"2024-04-25T13:41:06.376048+0000","last_peered":"2024-04-25T13:41:06.376048+0000","last_clean":"2024-04-25T13:41:06.376048+0000","last_became_active":"2024-04-25T13:41:03.440886+0000","last_became_peered":"2024-04-25T13:41:03.440886+0000","last_unstale":"2024-04-25T13:41:06.376048+0000","last_undegraded":"2024-04-25T13:41:06.376048+0000","last_fullsized":"2024-04-25T13:41:06.376048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081156+0000","last_change":"2024-04-25T13:41:04.423577+0000","last_active":"2024-04-25T13:41:07.081156+0000","last_peered":"2024-04-25T13:41:07.081156+0000","last_clean":"2024-04-25T13:41:07.081156+0000","last_became_active":"2024-04-25T13:41:04.422496+0000","last_became_peered":"2024-04-25T13:41:04.422496+0000","last_unstale":"2024-04-25T13:41:07.081156+0000","last_undegraded":"2024-04-25T13:41:07.081156+0000","last_fullsized":"2024-04-25T13:41:07.081156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272735+0000","last_change":"2024-04-25T13:41:03.418067+0000","last_active":"2024-04-25T13:41:06.272735+0000","last_peered":"2024-04-25T13:41:06.272735+0000","last_clean":"2024-04-25T13:41:06.272735+0000","last_became_active":"2024-04-25T13:41:03.417592+0000","last_became_peered":"2024-04-25T13:41:03.417592+0000","last_unstale":"2024-04-25T13:41:06.272735+0000","last_undegraded":"2024-04-25T13:41:06.272735+0000","last_fullsized":"2024-04-25T13:41:06.272735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272712+0000","last_change":"2024-04-25T13:41:04.410387+0000","last_active":"2024-04-25T13:41:06.272712+0000","last_peered":"2024-04-25T13:41:06.272712+0000","last_clean":"2024-04-25T13:41:06.272712+0000","last_became_active":"2024-04-25T13:41:04.410065+0000","last_became_peered":"2024-04-25T13:41:04.410065+0000","last_unstale":"2024-04-25T13:41:06.272712+0000","last_undegraded":"2024-04-25T13:41:06.272712+0000","last_fullsized":"2024-04-25T13:41:06.272712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081075+0000","last_change":"2024-04-25T13:41:03.425103+0000","last_active":"2024-04-25T13:41:07.081075+0000","last_peered":"2024-04-25T13:41:07.081075+0000","last_clean":"2024-04-25T13:41:07.081075+0000","last_became_active":"2024-04-25T13:41:03.424688+0000","last_became_peered":"2024-04-25T13:41:03.424688+0000","last_unstale":"2024-04-25T13:41:07.081075+0000","last_undegraded":"2024-04-25T13:41:07.081075+0000","last_fullsized":"2024-04-25T13:41:07.081075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:51.359222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":666555,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":666611,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:41:08.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:41:08.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507c35d640 1 Processor -- start 2024-04-25T13:41:08.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507c35d640 1 -- start start 2024-04-25T13:41:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507c35d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f507414f500 0x7f507414f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507c35d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50740a8900 con 0x7f50740a5da0 2024-04-25T13:41:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507c35d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50740a8ba0 con 0x7f507414e9e0 2024-04-25T13:41:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507c35d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f5074074770 con 0x7f507414f500 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507a0f9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f50740a5da0 0x7f507406f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42712/0 (socket says 172.21.15.77:42712) 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507a0f9640 1 -- 172.21.15.77:0/3490388274 learned_addr learned my addr 172.21.15.77:0/3490388274 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507a8fa640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f507414f500 0x7f507414f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 170379589 0 0) 0x7f50740a8900 con 0x7f50740a5da0 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5060005740 con 0x7f50740a5da0 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 283213738 0 0) 0x7f5060005740 con 0x7f50740a5da0 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f507414f500 msgr2=0x7f507414f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f507414f500 0x7f507414f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 >> v1:172.21.15.96:6789/0 conn(0x7f507414e9e0 legacy=0x7f507414edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50740a7c00 con 0x7f50740a5da0 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f5068001820 con 0x7f50740a5da0 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 >> v1:172.21.15.77:6789/0 conn(0x7f50740a5da0 legacy=0x7f507406f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5060005c00 0x7f5060006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f507414f500 0x7f5060006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5060006f60 0x7f5060007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5074074770 con 0x7f5060005c00 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f506000ddd0 con 0x7f5060006f60 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f506000dfd0 con 0x7f507414f500 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.691+0000 7f507a0f9640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5060005c00 0x7f5060006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507a8fa640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5060006f60 0x7f5060007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507a0f9640 1 -- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f507414f500 msgr2=0x7f5060006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507a0f9640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f507414f500 0x7f5060006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507a0f9640 1 -- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5060006f60 msgr2=0x7f5060007370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507a0f9640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5060006f60 0x7f5060007370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507a0f9640 1 -- 172.21.15.77:0/3490388274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5060005740 con 0x7f5060005c00 2024-04-25T13:41:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507a8fa640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5060006f60 0x7f5060007370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507a0f9640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5060005c00 0x7f5060006070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f50740a8ad0 tx=0x7f506801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e54a817d67ea8c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068007d60 con 0x7f5060005c00 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50680a9070 con 0x7f5060005c00 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f50790f7640 1 -- 172.21.15.77:0/3490388274 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50680074b0 con 0x7f5060005c00 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507c35d640 1 -- 172.21.15.77:0/3490388274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5060005c00 msgr2=0x7f5060006070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507c35d640 1 --2- 172.21.15.77:0/3490388274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5060005c00 0x7f5060006070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f50740a8ad0 tx=0x7f506801ca60 comp rx=0 tx=0).stop 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507a8fa640 1 -- 172.21.15.77:0/3490388274 reap_dead start 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507c35d640 1 -- 172.21.15.77:0/3490388274 shutdown_connections 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507c35d640 1 -- 172.21.15.77:0/3490388274 >> 172.21.15.77:0/3490388274 conn(0x7f50740c02a0 msgr2=0x7f50740c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507c35d640 1 -- 172.21.15.77:0/3490388274 shutdown_connections 2024-04-25T13:41:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.695+0000 7f507c35d640 1 -- 172.21.15.77:0/3490388274 wait complete. 2024-04-25T13:41:08.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 Processor -- start 2024-04-25T13:41:08.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 -- start start 2024-04-25T13:41:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f507413af40 0x7f50741418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50741eb550 0x7f5074139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507413a9f0 0x7f5074139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5074071c90 con 0x7f507413a9f0 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5074071b10 con 0x7f507413af40 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f5074071e10 con 0x7f50741eb550 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a8fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507413a9f0 0x7f5074139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a8fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507413a9f0 0x7f5074139e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36096/0 (socket says 172.21.15.77:36096) 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a8fa640 1 -- 172.21.15.77:0/631944430 learned_addr learned my addr 172.21.15.77:0/631944430 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a0f9640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f507413af40 0x7f50741418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f50798f8640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50741eb550 0x7f5074139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a8fa640 1 -- 172.21.15.77:0/631944430 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50741eb550 msgr2=0x7f5074139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a8fa640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50741eb550 0x7f5074139910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a8fa640 1 -- 172.21.15.77:0/631944430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f507413af40 msgr2=0x7f50741418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a8fa640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f507413af40 0x7f50741418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a8fa640 1 -- 172.21.15.77:0/631944430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507413a5b0 con 0x7f507413a9f0 2024-04-25T13:41:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507a8fa640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507413a9f0 0x7f5074139e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5074070470 tx=0x7f506c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f5066ffd640 1 -- 172.21.15.77:0/631944430 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c01c070 con 0x7f507413a9f0 2024-04-25T13:41:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f5066ffd640 1 -- 172.21.15.77:0/631944430 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f506c00fe90 con 0x7f507413a9f0 2024-04-25T13:41:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5074141e10 con 0x7f507413a9f0 2024-04-25T13:41:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f5066ffd640 1 -- 172.21.15.77:0/631944430 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c017620 con 0x7f507413a9f0 2024-04-25T13:41:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507413c850 con 0x7f507413a9f0 2024-04-25T13:41:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.699+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f507406a280 con 0x7f507413a9f0 2024-04-25T13:41:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.703+0000 7f5066ffd640 1 -- 172.21.15.77:0/631944430 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f506c01f070 con 0x7f507413a9f0 2024-04-25T13:41:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.703+0000 7f5066ffd640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f505806f400 0x7f5058071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.703+0000 7f507a0f9640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f505806f400 0x7f5058071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.703+0000 7f5066ffd640 1 -- 172.21.15.77:0/631944430 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f506c08f250 con 0x7f507413a9f0 2024-04-25T13:41:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.703+0000 7f507a0f9640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f505806f400 0x7f5058071910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50680ab000 tx=0x7f50680b0040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:08.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.707+0000 7f5066ffd640 1 -- 172.21.15.77:0/631944430 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f506c012070 con 0x7f507413a9f0 2024-04-25T13:41:08.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.851+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5074140bf0 con 0x7f505806f400 2024-04-25T13:41:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.867+0000 7f5066ffd640 1 -- 172.21.15.77:0/631944430 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252017 (secure 0 0 0) 0x7f50680fb890 con 0x7f505806f400 2024-04-25T13:41:08.871 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:08.872 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T13:41:08.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f505806f400 msgr2=0x7f5058071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f505806f400 0x7f5058071910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50680ab000 tx=0x7f50680b0040 comp rx=0 tx=0).stop 2024-04-25T13:41:08.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507413a9f0 msgr2=0x7f5074139e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:08.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507413a9f0 0x7f5074139e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5074070470 tx=0x7f506c00f4a0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 shutdown_connections 2024-04-25T13:41:08.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f505806f400 0x7f5058071910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507413a9f0 0x7f5074139e50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f50741eb550 0x7f5074139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 --2- 172.21.15.77:0/631944430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f507413af40 0x7f50741418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:08.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 >> 172.21.15.77:0/631944430 conn(0x7f50740c02a0 msgr2=0x7f5074073200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:08.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 shutdown_connections 2024-04-25T13:41:08.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:08.871+0000 7f507c35d640 1 -- 172.21.15.77:0/631944430 wait complete. 2024-04-25T13:41:08.890 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-25T13:41:08.366157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218048,"kb_used_data":1864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756672,"statfs":{"total":773094113280,"available":772870832128,"internally_reserved":0,"allocated":1908736,"data_stored":1777796,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.979698"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376520+0000","last_change":"2024-04-25T13:41:04.470225+0000","last_active":"2024-04-25T13:41:06.376520+0000","last_peered":"2024-04-25T13:41:06.376520+0000","last_clean":"2024-04-25T13:41:06.376520+0000","last_became_active":"2024-04-25T13:41:04.434108+0000","last_became_peered":"2024-04-25T13:41:04.434108+0000","last_unstale":"2024-04-25T13:41:06.376520+0000","last_undegraded":"2024-04-25T13:41:06.376520+0000","last_fullsized":"2024-04-25T13:41:06.376520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394570+0000","last_change":"2024-04-25T13:41:04.422886+0000","last_active":"2024-04-25T13:41:05.394570+0000","last_peered":"2024-04-25T13:41:05.394570+0000","last_clean":"2024-04-25T13:41:05.394570+0000","last_became_active":"2024-04-25T13:41:04.422546+0000","last_became_peered":"2024-04-25T13:41:04.422546+0000","last_unstale":"2024-04-25T13:41:05.394570+0000","last_undegraded":"2024-04-25T13:41:05.394570+0000","last_fullsized":"2024-04-25T13:41:05.394570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080522+0000","last_change":"2024-04-25T13:41:04.413021+0000","last_active":"2024-04-25T13:41:07.080522+0000","last_peered":"2024-04-25T13:41:07.080522+0000","last_clean":"2024-04-25T13:41:07.080522+0000","last_became_active":"2024-04-25T13:41:04.412382+0000","last_became_peered":"2024-04-25T13:41:04.412382+0000","last_unstale":"2024-04-25T13:41:07.080522+0000","last_undegraded":"2024-04-25T13:41:07.080522+0000","last_fullsized":"2024-04-25T13:41:07.080522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398030+0000","last_change":"2024-04-25T13:41:04.419756+0000","last_active":"2024-04-25T13:41:05.398030+0000","last_peered":"2024-04-25T13:41:05.398030+0000","last_clean":"2024-04-25T13:41:05.398030+0000","last_became_active":"2024-04-25T13:41:04.418367+0000","last_became_peered":"2024-04-25T13:41:04.418367+0000","last_unstale":"2024-04-25T13:41:05.398030+0000","last_undegraded":"2024-04-25T13:41:05.398030+0000","last_fullsized":"2024-04-25T13:41:05.398030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375397+0000","last_change":"2024-04-25T13:41:04.428788+0000","last_active":"2024-04-25T13:41:06.375397+0000","last_peered":"2024-04-25T13:41:06.375397+0000","last_clean":"2024-04-25T13:41:06.375397+0000","last_became_active":"2024-04-25T13:41:04.428424+0000","last_became_peered":"2024-04-25T13:41:04.428424+0000","last_unstale":"2024-04-25T13:41:06.375397+0000","last_undegraded":"2024-04-25T13:41:06.375397+0000","last_fullsized":"2024-04-25T13:41:06.375397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397757+0000","last_change":"2024-04-25T13:41:04.432387+0000","last_active":"2024-04-25T13:41:05.397757+0000","last_peered":"2024-04-25T13:41:05.397757+0000","last_clean":"2024-04-25T13:41:05.397757+0000","last_became_active":"2024-04-25T13:41:04.431971+0000","last_became_peered":"2024-04-25T13:41:04.431971+0000","last_unstale":"2024-04-25T13:41:05.397757+0000","last_undegraded":"2024-04-25T13:41:05.397757+0000","last_fullsized":"2024-04-25T13:41:05.397757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375149+0000","last_change":"2024-04-25T13:41:04.473786+0000","last_active":"2024-04-25T13:41:06.375149+0000","last_peered":"2024-04-25T13:41:06.375149+0000","last_clean":"2024-04-25T13:41:06.375149+0000","last_became_active":"2024-04-25T13:41:04.471082+0000","last_became_peered":"2024-04-25T13:41:04.471082+0000","last_unstale":"2024-04-25T13:41:06.375149+0000","last_undegraded":"2024-04-25T13:41:06.375149+0000","last_fullsized":"2024-04-25T13:41:06.375149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271553+0000","last_change":"2024-04-25T13:41:04.410956+0000","last_active":"2024-04-25T13:41:06.271553+0000","last_peered":"2024-04-25T13:41:06.271553+0000","last_clean":"2024-04-25T13:41:06.271553+0000","last_became_active":"2024-04-25T13:41:04.410665+0000","last_became_peered":"2024-04-25T13:41:04.410665+0000","last_unstale":"2024-04-25T13:41:06.271553+0000","last_undegraded":"2024-04-25T13:41:06.271553+0000","last_fullsized":"2024-04-25T13:41:06.271553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376873+0000","last_change":"2024-04-25T13:41:04.470410+0000","last_active":"2024-04-25T13:41:06.376873+0000","last_peered":"2024-04-25T13:41:06.376873+0000","last_clean":"2024-04-25T13:41:06.376873+0000","last_became_active":"2024-04-25T13:41:04.434676+0000","last_became_peered":"2024-04-25T13:41:04.434676+0000","last_unstale":"2024-04-25T13:41:06.376873+0000","last_undegraded":"2024-04-25T13:41:06.376873+0000","last_fullsized":"2024-04-25T13:41:06.376873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083063+0000","last_change":"2024-04-25T13:41:04.417498+0000","last_active":"2024-04-25T13:41:07.083063+0000","last_peered":"2024-04-25T13:41:07.083063+0000","last_clean":"2024-04-25T13:41:07.083063+0000","last_became_active":"2024-04-25T13:41:04.417145+0000","last_became_peered":"2024-04-25T13:41:04.417145+0000","last_unstale":"2024-04-25T13:41:07.083063+0000","last_undegraded":"2024-04-25T13:41:07.083063+0000","last_fullsized":"2024-04-25T13:41:07.083063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082677+0000","last_change":"2024-04-25T13:41:04.417324+0000","last_active":"2024-04-25T13:41:07.082677+0000","last_peered":"2024-04-25T13:41:07.082677+0000","last_clean":"2024-04-25T13:41:07.082677+0000","last_became_active":"2024-04-25T13:41:04.416982+0000","last_became_peered":"2024-04-25T13:41:04.416982+0000","last_unstale":"2024-04-25T13:41:07.082677+0000","last_undegraded":"2024-04-25T13:41:07.082677+0000","last_fullsized":"2024-04-25T13:41:07.082677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084913+0000","last_change":"2024-04-25T13:41:04.412869+0000","last_active":"2024-04-25T13:41:07.084913+0000","last_peered":"2024-04-25T13:41:07.084913+0000","last_clean":"2024-04-25T13:41:07.084913+0000","last_became_active":"2024-04-25T13:41:04.412544+0000","last_became_peered":"2024-04-25T13:41:04.412544+0000","last_unstale":"2024-04-25T13:41:07.084913+0000","last_undegraded":"2024-04-25T13:41:07.084913+0000","last_fullsized":"2024-04-25T13:41:07.084913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272972+0000","last_change":"2024-04-25T13:41:04.412143+0000","last_active":"2024-04-25T13:41:06.272972+0000","last_peered":"2024-04-25T13:41:06.272972+0000","last_clean":"2024-04-25T13:41:06.272972+0000","last_became_active":"2024-04-25T13:41:04.411840+0000","last_became_peered":"2024-04-25T13:41:04.411840+0000","last_unstale":"2024-04-25T13:41:06.272972+0000","last_undegraded":"2024-04-25T13:41:06.272972+0000","last_fullsized":"2024-04-25T13:41:06.272972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080138+0000","last_change":"2024-04-25T13:41:04.426859+0000","last_active":"2024-04-25T13:41:07.080138+0000","last_peered":"2024-04-25T13:41:07.080138+0000","last_clean":"2024-04-25T13:41:07.080138+0000","last_became_active":"2024-04-25T13:41:04.426437+0000","last_became_peered":"2024-04-25T13:41:04.426437+0000","last_unstale":"2024-04-25T13:41:07.080138+0000","last_undegraded":"2024-04-25T13:41:07.080138+0000","last_fullsized":"2024-04-25T13:41:07.080138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:21.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394006+0000","last_change":"2024-04-25T13:41:04.410712+0000","last_active":"2024-04-25T13:41:05.394006+0000","last_peered":"2024-04-25T13:41:05.394006+0000","last_clean":"2024-04-25T13:41:05.394006+0000","last_became_active":"2024-04-25T13:41:04.410362+0000","last_became_peered":"2024-04-25T13:41:04.410362+0000","last_unstale":"2024-04-25T13:41:05.394006+0000","last_undegraded":"2024-04-25T13:41:05.394006+0000","last_fullsized":"2024-04-25T13:41:05.394006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397254+0000","last_change":"2024-04-25T13:41:04.429493+0000","last_active":"2024-04-25T13:41:05.397254+0000","last_peered":"2024-04-25T13:41:05.397254+0000","last_clean":"2024-04-25T13:41:05.397254+0000","last_became_active":"2024-04-25T13:41:04.429116+0000","last_became_peered":"2024-04-25T13:41:04.429116+0000","last_unstale":"2024-04-25T13:41:05.397254+0000","last_undegraded":"2024-04-25T13:41:05.397254+0000","last_fullsized":"2024-04-25T13:41:05.397254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399835+0000","last_change":"2024-04-25T13:41:04.431688+0000","last_active":"2024-04-25T13:41:05.399835+0000","last_peered":"2024-04-25T13:41:05.399835+0000","last_clean":"2024-04-25T13:41:05.399835+0000","last_became_active":"2024-04-25T13:41:04.431231+0000","last_became_peered":"2024-04-25T13:41:04.431231+0000","last_unstale":"2024-04-25T13:41:05.399835+0000","last_undegraded":"2024-04-25T13:41:05.399835+0000","last_fullsized":"2024-04-25T13:41:05.399835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390359+0000","last_change":"2024-04-25T13:41:04.407914+0000","last_active":"2024-04-25T13:41:05.390359+0000","last_peered":"2024-04-25T13:41:05.390359+0000","last_clean":"2024-04-25T13:41:05.390359+0000","last_became_active":"2024-04-25T13:41:04.407553+0000","last_became_peered":"2024-04-25T13:41:04.407553+0000","last_unstale":"2024-04-25T13:41:05.390359+0000","last_undegraded":"2024-04-25T13:41:05.390359+0000","last_fullsized":"2024-04-25T13:41:05.390359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376272+0000","last_change":"2024-04-25T13:41:04.430301+0000","last_active":"2024-04-25T13:41:06.376272+0000","last_peered":"2024-04-25T13:41:06.376272+0000","last_clean":"2024-04-25T13:41:06.376272+0000","last_became_active":"2024-04-25T13:41:04.428597+0000","last_became_peered":"2024-04-25T13:41:04.428597+0000","last_unstale":"2024-04-25T13:41:06.376272+0000","last_undegraded":"2024-04-25T13:41:06.376272+0000","last_fullsized":"2024-04-25T13:41:06.376272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082158+0000","last_change":"2024-04-25T13:41:04.423772+0000","last_active":"2024-04-25T13:41:07.082158+0000","last_peered":"2024-04-25T13:41:07.082158+0000","last_clean":"2024-04-25T13:41:07.082158+0000","last_became_active":"2024-04-25T13:41:04.423453+0000","last_became_peered":"2024-04-25T13:41:04.423453+0000","last_unstale":"2024-04-25T13:41:07.082158+0000","last_undegraded":"2024-04-25T13:41:07.082158+0000","last_fullsized":"2024-04-25T13:41:07.082158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080752+0000","last_change":"2024-04-25T13:41:04.430195+0000","last_active":"2024-04-25T13:41:07.080752+0000","last_peered":"2024-04-25T13:41:07.080752+0000","last_clean":"2024-04-25T13:41:07.080752+0000","last_became_active":"2024-04-25T13:41:04.429917+0000","last_became_peered":"2024-04-25T13:41:04.429917+0000","last_unstale":"2024-04-25T13:41:07.080752+0000","last_undegraded":"2024-04-25T13:41:07.080752+0000","last_fullsized":"2024-04-25T13:41:07.080752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398046+0000","last_change":"2024-04-25T13:41:04.431579+0000","last_active":"2024-04-25T13:41:05.398046+0000","last_peered":"2024-04-25T13:41:05.398046+0000","last_clean":"2024-04-25T13:41:05.398046+0000","last_became_active":"2024-04-25T13:41:04.431160+0000","last_became_peered":"2024-04-25T13:41:04.431160+0000","last_unstale":"2024-04-25T13:41:05.398046+0000","last_undegraded":"2024-04-25T13:41:05.398046+0000","last_fullsized":"2024-04-25T13:41:05.398046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271836+0000","last_change":"2024-04-25T13:41:04.423185+0000","last_active":"2024-04-25T13:41:06.271836+0000","last_peered":"2024-04-25T13:41:06.271836+0000","last_clean":"2024-04-25T13:41:06.271836+0000","last_became_active":"2024-04-25T13:41:04.422815+0000","last_became_peered":"2024-04-25T13:41:04.422815+0000","last_unstale":"2024-04-25T13:41:06.271836+0000","last_undegraded":"2024-04-25T13:41:06.271836+0000","last_fullsized":"2024-04-25T13:41:06.271836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397647+0000","last_change":"2024-04-25T13:41:04.415522+0000","last_active":"2024-04-25T13:41:05.397647+0000","last_peered":"2024-04-25T13:41:05.397647+0000","last_clean":"2024-04-25T13:41:05.397647+0000","last_became_active":"2024-04-25T13:41:04.414898+0000","last_became_peered":"2024-04-25T13:41:04.414898+0000","last_unstale":"2024-04-25T13:41:05.397647+0000","last_undegraded":"2024-04-25T13:41:05.397647+0000","last_fullsized":"2024-04-25T13:41:05.397647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272770+0000","last_change":"2024-04-25T13:41:04.422142+0000","last_active":"2024-04-25T13:41:06.272770+0000","last_peered":"2024-04-25T13:41:06.272770+0000","last_clean":"2024-04-25T13:41:06.272770+0000","last_became_active":"2024-04-25T13:41:04.421279+0000","last_became_peered":"2024-04-25T13:41:04.421279+0000","last_unstale":"2024-04-25T13:41:06.272770+0000","last_undegraded":"2024-04-25T13:41:06.272770+0000","last_fullsized":"2024-04-25T13:41:06.272770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083116+0000","last_change":"2024-04-25T13:41:04.431595+0000","last_active":"2024-04-25T13:41:07.083116+0000","last_peered":"2024-04-25T13:41:07.083116+0000","last_clean":"2024-04-25T13:41:07.083116+0000","last_became_active":"2024-04-25T13:41:04.431130+0000","last_became_peered":"2024-04-25T13:41:04.431130+0000","last_unstale":"2024-04-25T13:41:07.083116+0000","last_undegraded":"2024-04-25T13:41:07.083116+0000","last_fullsized":"2024-04-25T13:41:07.083116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394417+0000","last_change":"2024-04-25T13:41:04.413732+0000","last_active":"2024-04-25T13:41:05.394417+0000","last_peered":"2024-04-25T13:41:05.394417+0000","last_clean":"2024-04-25T13:41:05.394417+0000","last_became_active":"2024-04-25T13:41:04.413001+0000","last_became_peered":"2024-04-25T13:41:04.413001+0000","last_unstale":"2024-04-25T13:41:05.394417+0000","last_undegraded":"2024-04-25T13:41:05.394417+0000","last_fullsized":"2024-04-25T13:41:05.394417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272664+0000","last_change":"2024-04-25T13:41:04.421963+0000","last_active":"2024-04-25T13:41:06.272664+0000","last_peered":"2024-04-25T13:41:06.272664+0000","last_clean":"2024-04-25T13:41:06.272664+0000","last_became_active":"2024-04-25T13:41:04.421439+0000","last_became_peered":"2024-04-25T13:41:04.421439+0000","last_unstale":"2024-04-25T13:41:06.272664+0000","last_undegraded":"2024-04-25T13:41:06.272664+0000","last_fullsized":"2024-04-25T13:41:06.272664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080989+0000","last_change":"2024-04-25T13:41:04.423204+0000","last_active":"2024-04-25T13:41:07.080989+0000","last_peered":"2024-04-25T13:41:07.080989+0000","last_clean":"2024-04-25T13:41:07.080989+0000","last_became_active":"2024-04-25T13:41:04.422855+0000","last_became_peered":"2024-04-25T13:41:04.422855+0000","last_unstale":"2024-04-25T13:41:07.080989+0000","last_undegraded":"2024-04-25T13:41:07.080989+0000","last_fullsized":"2024-04-25T13:41:07.080989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398240+0000","last_change":"2024-04-25T13:41:04.416506+0000","last_active":"2024-04-25T13:41:05.398240+0000","last_peered":"2024-04-25T13:41:05.398240+0000","last_clean":"2024-04-25T13:41:05.398240+0000","last_became_active":"2024-04-25T13:41:04.416177+0000","last_became_peered":"2024-04-25T13:41:04.416177+0000","last_unstale":"2024-04-25T13:41:05.398240+0000","last_undegraded":"2024-04-25T13:41:05.398240+0000","last_fullsized":"2024-04-25T13:41:05.398240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390077+0000","last_change":"2024-04-25T13:41:04.414817+0000","last_active":"2024-04-25T13:41:05.390077+0000","last_peered":"2024-04-25T13:41:05.390077+0000","last_clean":"2024-04-25T13:41:05.390077+0000","last_became_active":"2024-04-25T13:41:04.414178+0000","last_became_peered":"2024-04-25T13:41:04.414178+0000","last_unstale":"2024-04-25T13:41:05.390077+0000","last_undegraded":"2024-04-25T13:41:05.390077+0000","last_fullsized":"2024-04-25T13:41:05.390077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081720+0000","last_change":"2024-04-25T13:41:04.430078+0000","last_active":"2024-04-25T13:41:07.081720+0000","last_peered":"2024-04-25T13:41:07.081720+0000","last_clean":"2024-04-25T13:41:07.081720+0000","last_became_active":"2024-04-25T13:41:04.429518+0000","last_became_peered":"2024-04-25T13:41:04.429518+0000","last_unstale":"2024-04-25T13:41:07.081720+0000","last_undegraded":"2024-04-25T13:41:07.081720+0000","last_fullsized":"2024-04-25T13:41:07.081720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084010+0000","last_change":"2024-04-25T13:41:04.402158+0000","last_active":"2024-04-25T13:41:07.084010+0000","last_peered":"2024-04-25T13:41:07.084010+0000","last_clean":"2024-04-25T13:41:07.084010+0000","last_became_active":"2024-04-25T13:41:04.401821+0000","last_became_peered":"2024-04-25T13:41:04.401821+0000","last_unstale":"2024-04-25T13:41:07.084010+0000","last_undegraded":"2024-04-25T13:41:07.084010+0000","last_fullsized":"2024-04-25T13:41:07.084010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:18.457935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272477+0000","last_change":"2024-04-25T13:41:03.425690+0000","last_active":"2024-04-25T13:41:06.272477+0000","last_peered":"2024-04-25T13:41:06.272477+0000","last_clean":"2024-04-25T13:41:06.272477+0000","last_became_active":"2024-04-25T13:41:03.425239+0000","last_became_peered":"2024-04-25T13:41:03.425239+0000","last_unstale":"2024-04-25T13:41:06.272477+0000","last_undegraded":"2024-04-25T13:41:06.272477+0000","last_fullsized":"2024-04-25T13:41:06.272477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081045+0000","last_change":"2024-04-25T13:41:04.411250+0000","last_active":"2024-04-25T13:41:07.081045+0000","last_peered":"2024-04-25T13:41:07.081045+0000","last_clean":"2024-04-25T13:41:07.081045+0000","last_became_active":"2024-04-25T13:41:04.400223+0000","last_became_peered":"2024-04-25T13:41:04.400223+0000","last_unstale":"2024-04-25T13:41:07.081045+0000","last_undegraded":"2024-04-25T13:41:07.081045+0000","last_fullsized":"2024-04-25T13:41:07.081045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081971+0000","last_change":"2024-04-25T13:41:03.435467+0000","last_active":"2024-04-25T13:41:07.081971+0000","last_peered":"2024-04-25T13:41:07.081971+0000","last_clean":"2024-04-25T13:41:07.081971+0000","last_became_active":"2024-04-25T13:41:03.426677+0000","last_became_peered":"2024-04-25T13:41:03.426677+0000","last_unstale":"2024-04-25T13:41:07.081971+0000","last_undegraded":"2024-04-25T13:41:07.081971+0000","last_fullsized":"2024-04-25T13:41:07.081971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271566+0000","last_change":"2024-04-25T13:41:03.437180+0000","last_active":"2024-04-25T13:41:06.271566+0000","last_peered":"2024-04-25T13:41:06.271566+0000","last_clean":"2024-04-25T13:41:06.271566+0000","last_became_active":"2024-04-25T13:41:03.436905+0000","last_became_peered":"2024-04-25T13:41:03.436905+0000","last_unstale":"2024-04-25T13:41:06.271566+0000","last_undegraded":"2024-04-25T13:41:06.271566+0000","last_fullsized":"2024-04-25T13:41:06.271566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271768+0000","last_change":"2024-04-25T13:41:04.423777+0000","last_active":"2024-04-25T13:41:06.271768+0000","last_peered":"2024-04-25T13:41:06.271768+0000","last_clean":"2024-04-25T13:41:06.271768+0000","last_became_active":"2024-04-25T13:41:04.423470+0000","last_became_peered":"2024-04-25T13:41:04.423470+0000","last_unstale":"2024-04-25T13:41:06.271768+0000","last_undegraded":"2024-04-25T13:41:06.271768+0000","last_fullsized":"2024-04-25T13:41:06.271768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397437+0000","last_change":"2024-04-25T13:41:03.445205+0000","last_active":"2024-04-25T13:41:05.397437+0000","last_peered":"2024-04-25T13:41:05.397437+0000","last_clean":"2024-04-25T13:41:05.397437+0000","last_became_active":"2024-04-25T13:41:03.444412+0000","last_became_peered":"2024-04-25T13:41:03.444412+0000","last_unstale":"2024-04-25T13:41:05.397437+0000","last_undegraded":"2024-04-25T13:41:05.397437+0000","last_fullsized":"2024-04-25T13:41:05.397437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.393826+0000","last_change":"2024-04-25T13:41:04.413827+0000","last_active":"2024-04-25T13:41:05.393826+0000","last_peered":"2024-04-25T13:41:05.393826+0000","last_clean":"2024-04-25T13:41:05.393826+0000","last_became_active":"2024-04-25T13:41:04.413496+0000","last_became_peered":"2024-04-25T13:41:04.413496+0000","last_unstale":"2024-04-25T13:41:05.393826+0000","last_undegraded":"2024-04-25T13:41:05.393826+0000","last_fullsized":"2024-04-25T13:41:05.393826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082917+0000","last_change":"2024-04-25T13:41:03.450428+0000","last_active":"2024-04-25T13:41:07.082917+0000","last_peered":"2024-04-25T13:41:07.082917+0000","last_clean":"2024-04-25T13:41:07.082917+0000","last_became_active":"2024-04-25T13:41:03.449629+0000","last_became_peered":"2024-04-25T13:41:03.449629+0000","last_unstale":"2024-04-25T13:41:07.082917+0000","last_undegraded":"2024-04-25T13:41:07.082917+0000","last_fullsized":"2024-04-25T13:41:07.082917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399527+0000","last_change":"2024-04-25T13:41:04.431979+0000","last_active":"2024-04-25T13:41:05.399527+0000","last_peered":"2024-04-25T13:41:05.399527+0000","last_clean":"2024-04-25T13:41:05.399527+0000","last_became_active":"2024-04-25T13:41:04.431218+0000","last_became_peered":"2024-04-25T13:41:04.431218+0000","last_unstale":"2024-04-25T13:41:05.399527+0000","last_undegraded":"2024-04-25T13:41:05.399527+0000","last_fullsized":"2024-04-25T13:41:05.399527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399630+0000","last_change":"2024-04-25T13:41:03.445209+0000","last_active":"2024-04-25T13:41:05.399630+0000","last_peered":"2024-04-25T13:41:05.399630+0000","last_clean":"2024-04-25T13:41:05.399630+0000","last_became_active":"2024-04-25T13:41:03.444460+0000","last_became_peered":"2024-04-25T13:41:03.444460+0000","last_unstale":"2024-04-25T13:41:05.399630+0000","last_undegraded":"2024-04-25T13:41:05.399630+0000","last_fullsized":"2024-04-25T13:41:05.399630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080960+0000","last_change":"2024-04-25T13:41:04.423661+0000","last_active":"2024-04-25T13:41:07.080960+0000","last_peered":"2024-04-25T13:41:07.080960+0000","last_clean":"2024-04-25T13:41:07.080960+0000","last_became_active":"2024-04-25T13:41:04.421991+0000","last_became_peered":"2024-04-25T13:41:04.421991+0000","last_unstale":"2024-04-25T13:41:07.080960+0000","last_undegraded":"2024-04-25T13:41:07.080960+0000","last_fullsized":"2024-04-25T13:41:07.080960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394142+0000","last_change":"2024-04-25T13:41:03.443960+0000","last_active":"2024-04-25T13:41:05.394142+0000","last_peered":"2024-04-25T13:41:05.394142+0000","last_clean":"2024-04-25T13:41:05.394142+0000","last_became_active":"2024-04-25T13:41:03.443721+0000","last_became_peered":"2024-04-25T13:41:03.443721+0000","last_unstale":"2024-04-25T13:41:05.394142+0000","last_undegraded":"2024-04-25T13:41:05.394142+0000","last_fullsized":"2024-04-25T13:41:05.394142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.085160+0000","last_change":"2024-04-25T13:41:04.423896+0000","last_active":"2024-04-25T13:41:07.085160+0000","last_peered":"2024-04-25T13:41:07.085160+0000","last_clean":"2024-04-25T13:41:07.085160+0000","last_became_active":"2024-04-25T13:41:04.423569+0000","last_became_peered":"2024-04-25T13:41:04.423569+0000","last_unstale":"2024-04-25T13:41:07.085160+0000","last_undegraded":"2024-04-25T13:41:07.085160+0000","last_fullsized":"2024-04-25T13:41:07.085160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081924+0000","last_change":"2024-04-25T13:41:03.426055+0000","last_active":"2024-04-25T13:41:07.081924+0000","last_peered":"2024-04-25T13:41:07.081924+0000","last_clean":"2024-04-25T13:41:07.081924+0000","last_became_active":"2024-04-25T13:41:03.424990+0000","last_became_peered":"2024-04-25T13:41:03.424990+0000","last_unstale":"2024-04-25T13:41:07.081924+0000","last_undegraded":"2024-04-25T13:41:07.081924+0000","last_fullsized":"2024-04-25T13:41:07.081924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375890+0000","last_change":"2024-04-25T13:41:04.430564+0000","last_active":"2024-04-25T13:41:06.375890+0000","last_peered":"2024-04-25T13:41:06.375890+0000","last_clean":"2024-04-25T13:41:06.375890+0000","last_became_active":"2024-04-25T13:41:04.427802+0000","last_became_peered":"2024-04-25T13:41:04.427802+0000","last_unstale":"2024-04-25T13:41:06.375890+0000","last_undegraded":"2024-04-25T13:41:06.375890+0000","last_fullsized":"2024-04-25T13:41:06.375890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081161+0000","last_change":"2024-04-25T13:41:03.422851+0000","last_active":"2024-04-25T13:41:07.081161+0000","last_peered":"2024-04-25T13:41:07.081161+0000","last_clean":"2024-04-25T13:41:07.081161+0000","last_became_active":"2024-04-25T13:41:03.422529+0000","last_became_peered":"2024-04-25T13:41:03.422529+0000","last_unstale":"2024-04-25T13:41:07.081161+0000","last_undegraded":"2024-04-25T13:41:07.081161+0000","last_fullsized":"2024-04-25T13:41:07.081161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080588+0000","last_change":"2024-04-25T13:41:04.429077+0000","last_active":"2024-04-25T13:41:07.080588+0000","last_peered":"2024-04-25T13:41:07.080588+0000","last_clean":"2024-04-25T13:41:07.080588+0000","last_became_active":"2024-04-25T13:41:04.428641+0000","last_became_peered":"2024-04-25T13:41:04.428641+0000","last_unstale":"2024-04-25T13:41:07.080588+0000","last_undegraded":"2024-04-25T13:41:07.080588+0000","last_fullsized":"2024-04-25T13:41:07.080588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398137+0000","last_change":"2024-04-25T13:41:03.450649+0000","last_active":"2024-04-25T13:41:05.398137+0000","last_peered":"2024-04-25T13:41:05.398137+0000","last_clean":"2024-04-25T13:41:05.398137+0000","last_became_active":"2024-04-25T13:41:03.449872+0000","last_became_peered":"2024-04-25T13:41:03.449872+0000","last_unstale":"2024-04-25T13:41:05.398137+0000","last_undegraded":"2024-04-25T13:41:05.398137+0000","last_fullsized":"2024-04-25T13:41:05.398137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375589+0000","last_change":"2024-04-25T13:41:04.434947+0000","last_active":"2024-04-25T13:41:06.375589+0000","last_peered":"2024-04-25T13:41:06.375589+0000","last_clean":"2024-04-25T13:41:06.375589+0000","last_became_active":"2024-04-25T13:41:04.434502+0000","last_became_peered":"2024-04-25T13:41:04.434502+0000","last_unstale":"2024-04-25T13:41:06.375589+0000","last_undegraded":"2024-04-25T13:41:06.375589+0000","last_fullsized":"2024-04-25T13:41:06.375589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081461+0000","last_change":"2024-04-25T13:41:03.423826+0000","last_active":"2024-04-25T13:41:07.081461+0000","last_peered":"2024-04-25T13:41:07.081461+0000","last_clean":"2024-04-25T13:41:07.081461+0000","last_became_active":"2024-04-25T13:41:03.423037+0000","last_became_peered":"2024-04-25T13:41:03.423037+0000","last_unstale":"2024-04-25T13:41:07.081461+0000","last_undegraded":"2024-04-25T13:41:07.081461+0000","last_fullsized":"2024-04-25T13:41:07.081461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081702+0000","last_change":"2024-04-25T13:41:04.429831+0000","last_active":"2024-04-25T13:41:07.081702+0000","last_peered":"2024-04-25T13:41:07.081702+0000","last_clean":"2024-04-25T13:41:07.081702+0000","last_became_active":"2024-04-25T13:41:04.429110+0000","last_became_peered":"2024-04-25T13:41:04.429110+0000","last_unstale":"2024-04-25T13:41:07.081702+0000","last_undegraded":"2024-04-25T13:41:07.081702+0000","last_fullsized":"2024-04-25T13:41:07.081702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.389771+0000","last_change":"2024-04-25T13:41:03.409148+0000","last_active":"2024-04-25T13:41:05.389771+0000","last_peered":"2024-04-25T13:41:05.389771+0000","last_clean":"2024-04-25T13:41:05.389771+0000","last_became_active":"2024-04-25T13:41:03.408414+0000","last_became_peered":"2024-04-25T13:41:03.408414+0000","last_unstale":"2024-04-25T13:41:05.389771+0000","last_undegraded":"2024-04-25T13:41:05.389771+0000","last_fullsized":"2024-04-25T13:41:05.389771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375388+0000","last_change":"2024-04-25T13:41:04.426477+0000","last_active":"2024-04-25T13:41:06.375388+0000","last_peered":"2024-04-25T13:41:06.375388+0000","last_clean":"2024-04-25T13:41:06.375388+0000","last_became_active":"2024-04-25T13:41:04.425891+0000","last_became_peered":"2024-04-25T13:41:04.425891+0000","last_unstale":"2024-04-25T13:41:06.375388+0000","last_undegraded":"2024-04-25T13:41:06.375388+0000","last_fullsized":"2024-04-25T13:41:06.375388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084806+0000","last_change":"2024-04-25T13:41:03.421716+0000","last_active":"2024-04-25T13:41:07.084806+0000","last_peered":"2024-04-25T13:41:07.084806+0000","last_clean":"2024-04-25T13:41:07.084806+0000","last_became_active":"2024-04-25T13:41:03.420848+0000","last_became_peered":"2024-04-25T13:41:03.420848+0000","last_unstale":"2024-04-25T13:41:07.084806+0000","last_undegraded":"2024-04-25T13:41:07.084806+0000","last_fullsized":"2024-04-25T13:41:07.084806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.389116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376433+0000","last_change":"2024-04-25T13:41:04.429840+0000","last_active":"2024-04-25T13:41:06.376433+0000","last_peered":"2024-04-25T13:41:06.376433+0000","last_clean":"2024-04-25T13:41:06.376433+0000","last_became_active":"2024-04-25T13:41:04.429404+0000","last_became_peered":"2024-04-25T13:41:04.429404+0000","last_unstale":"2024-04-25T13:41:06.376433+0000","last_undegraded":"2024-04-25T13:41:06.376433+0000","last_fullsized":"2024-04-25T13:41:06.376433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390507+0000","last_change":"2024-04-25T13:41:03.415723+0000","last_active":"2024-04-25T13:41:05.390507+0000","last_peered":"2024-04-25T13:41:05.390507+0000","last_clean":"2024-04-25T13:41:05.390507+0000","last_became_active":"2024-04-25T13:41:03.414957+0000","last_became_peered":"2024-04-25T13:41:03.414957+0000","last_unstale":"2024-04-25T13:41:05.390507+0000","last_undegraded":"2024-04-25T13:41:05.390507+0000","last_fullsized":"2024-04-25T13:41:05.390507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376788+0000","last_change":"2024-04-25T13:41:04.434675+0000","last_active":"2024-04-25T13:41:06.376788+0000","last_peered":"2024-04-25T13:41:06.376788+0000","last_clean":"2024-04-25T13:41:06.376788+0000","last_became_active":"2024-04-25T13:41:04.434194+0000","last_became_peered":"2024-04-25T13:41:04.434194+0000","last_unstale":"2024-04-25T13:41:06.376788+0000","last_undegraded":"2024-04-25T13:41:06.376788+0000","last_fullsized":"2024-04-25T13:41:06.376788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394277+0000","last_change":"2024-04-25T13:41:03.402131+0000","last_active":"2024-04-25T13:41:05.394277+0000","last_peered":"2024-04-25T13:41:05.394277+0000","last_clean":"2024-04-25T13:41:05.394277+0000","last_became_active":"2024-04-25T13:41:03.401398+0000","last_became_peered":"2024-04-25T13:41:03.401398+0000","last_unstale":"2024-04-25T13:41:05.394277+0000","last_undegraded":"2024-04-25T13:41:05.394277+0000","last_fullsized":"2024-04-25T13:41:05.394277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398944+0000","last_change":"2024-04-25T13:41:04.418743+0000","last_active":"2024-04-25T13:41:05.398944+0000","last_peered":"2024-04-25T13:41:05.398944+0000","last_clean":"2024-04-25T13:41:05.398944+0000","last_became_active":"2024-04-25T13:41:04.417963+0000","last_became_peered":"2024-04-25T13:41:04.417963+0000","last_unstale":"2024-04-25T13:41:05.398944+0000","last_undegraded":"2024-04-25T13:41:05.398944+0000","last_fullsized":"2024-04-25T13:41:05.398944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390275+0000","last_change":"2024-04-25T13:41:03.445729+0000","last_active":"2024-04-25T13:41:05.390275+0000","last_peered":"2024-04-25T13:41:05.390275+0000","last_clean":"2024-04-25T13:41:05.390275+0000","last_became_active":"2024-04-25T13:41:03.445293+0000","last_became_peered":"2024-04-25T13:41:03.445293+0000","last_unstale":"2024-04-25T13:41:05.390275+0000","last_undegraded":"2024-04-25T13:41:05.390275+0000","last_fullsized":"2024-04-25T13:41:05.390275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375956+0000","last_change":"2024-04-25T13:41:04.429996+0000","last_active":"2024-04-25T13:41:06.375956+0000","last_peered":"2024-04-25T13:41:06.375956+0000","last_clean":"2024-04-25T13:41:06.375956+0000","last_became_active":"2024-04-25T13:41:04.428232+0000","last_became_peered":"2024-04-25T13:41:04.428232+0000","last_unstale":"2024-04-25T13:41:06.375956+0000","last_undegraded":"2024-04-25T13:41:06.375956+0000","last_fullsized":"2024-04-25T13:41:06.375956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375088+0000","last_change":"2024-04-25T13:41:00.175142+0000","last_active":"2024-04-25T13:41:06.375088+0000","last_peered":"2024-04-25T13:41:06.375088+0000","last_clean":"2024-04-25T13:41:06.375088+0000","last_became_active":"2024-04-25T13:41:00.172906+0000","last_became_peered":"2024-04-25T13:41:00.172906+0000","last_unstale":"2024-04-25T13:41:06.375088+0000","last_undegraded":"2024-04-25T13:41:06.375088+0000","last_fullsized":"2024-04-25T13:41:06.375088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_clean_scrub_stamp":"2024-04-25T13:40:59.093070+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:38.020124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397151+0000","last_change":"2024-04-25T13:41:03.438420+0000","last_active":"2024-04-25T13:41:05.397151+0000","last_peered":"2024-04-25T13:41:05.397151+0000","last_clean":"2024-04-25T13:41:05.397151+0000","last_became_active":"2024-04-25T13:41:03.437569+0000","last_became_peered":"2024-04-25T13:41:03.437569+0000","last_unstale":"2024-04-25T13:41:05.397151+0000","last_undegraded":"2024-04-25T13:41:05.397151+0000","last_fullsized":"2024-04-25T13:41:05.397151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272317+0000","last_change":"2024-04-25T13:41:04.417328+0000","last_active":"2024-04-25T13:41:06.272317+0000","last_peered":"2024-04-25T13:41:06.272317+0000","last_clean":"2024-04-25T13:41:06.272317+0000","last_became_active":"2024-04-25T13:41:04.416666+0000","last_became_peered":"2024-04-25T13:41:04.416666+0000","last_unstale":"2024-04-25T13:41:06.272317+0000","last_undegraded":"2024-04-25T13:41:06.272317+0000","last_fullsized":"2024-04-25T13:41:06.272317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.374736+0000","last_change":"2024-04-25T13:41:03.431855+0000","last_active":"2024-04-25T13:41:06.374736+0000","last_peered":"2024-04-25T13:41:06.374736+0000","last_clean":"2024-04-25T13:41:06.374736+0000","last_became_active":"2024-04-25T13:41:03.429200+0000","last_became_peered":"2024-04-25T13:41:03.429200+0000","last_unstale":"2024-04-25T13:41:06.374736+0000","last_undegraded":"2024-04-25T13:41:06.374736+0000","last_fullsized":"2024-04-25T13:41:06.374736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080267+0000","last_change":"2024-04-25T13:41:04.411548+0000","last_active":"2024-04-25T13:41:07.080267+0000","last_peered":"2024-04-25T13:41:07.080267+0000","last_clean":"2024-04-25T13:41:07.080267+0000","last_became_active":"2024-04-25T13:41:04.400093+0000","last_became_peered":"2024-04-25T13:41:04.400093+0000","last_unstale":"2024-04-25T13:41:07.080267+0000","last_undegraded":"2024-04-25T13:41:07.080267+0000","last_fullsized":"2024-04-25T13:41:07.080267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:09.999429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390174+0000","last_change":"2024-04-25T13:41:03.415949+0000","last_active":"2024-04-25T13:41:05.390174+0000","last_peered":"2024-04-25T13:41:05.390174+0000","last_clean":"2024-04-25T13:41:05.390174+0000","last_became_active":"2024-04-25T13:41:03.414899+0000","last_became_peered":"2024-04-25T13:41:03.414899+0000","last_unstale":"2024-04-25T13:41:05.390174+0000","last_undegraded":"2024-04-25T13:41:05.390174+0000","last_fullsized":"2024-04-25T13:41:05.390174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394211+0000","last_change":"2024-04-25T13:41:04.403032+0000","last_active":"2024-04-25T13:41:05.394211+0000","last_peered":"2024-04-25T13:41:05.394211+0000","last_clean":"2024-04-25T13:41:05.394211+0000","last_became_active":"2024-04-25T13:41:04.402055+0000","last_became_peered":"2024-04-25T13:41:04.402055+0000","last_unstale":"2024-04-25T13:41:05.394211+0000","last_undegraded":"2024-04-25T13:41:05.394211+0000","last_fullsized":"2024-04-25T13:41:05.394211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398292+0000","last_change":"2024-04-25T13:41:03.447547+0000","last_active":"2024-04-25T13:41:05.398292+0000","last_peered":"2024-04-25T13:41:05.398292+0000","last_clean":"2024-04-25T13:41:05.398292+0000","last_became_active":"2024-04-25T13:41:03.444429+0000","last_became_peered":"2024-04-25T13:41:03.444429+0000","last_unstale":"2024-04-25T13:41:05.398292+0000","last_undegraded":"2024-04-25T13:41:05.398292+0000","last_fullsized":"2024-04-25T13:41:05.398292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084597+0000","last_change":"2024-04-25T13:41:04.398647+0000","last_active":"2024-04-25T13:41:07.084597+0000","last_peered":"2024-04-25T13:41:07.084597+0000","last_clean":"2024-04-25T13:41:07.084597+0000","last_became_active":"2024-04-25T13:41:04.398287+0000","last_became_peered":"2024-04-25T13:41:04.398287+0000","last_unstale":"2024-04-25T13:41:07.084597+0000","last_undegraded":"2024-04-25T13:41:07.084597+0000","last_fullsized":"2024-04-25T13:41:07.084597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:06.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394703+0000","last_change":"2024-04-25T13:41:03.414535+0000","last_active":"2024-04-25T13:41:05.394703+0000","last_peered":"2024-04-25T13:41:05.394703+0000","last_clean":"2024-04-25T13:41:05.394703+0000","last_became_active":"2024-04-25T13:41:03.414145+0000","last_became_peered":"2024-04-25T13:41:03.414145+0000","last_unstale":"2024-04-25T13:41:05.394703+0000","last_undegraded":"2024-04-25T13:41:05.394703+0000","last_fullsized":"2024-04-25T13:41:05.394703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399648+0000","last_change":"2024-04-25T13:41:04.419186+0000","last_active":"2024-04-25T13:41:05.399648+0000","last_peered":"2024-04-25T13:41:05.399648+0000","last_clean":"2024-04-25T13:41:05.399648+0000","last_became_active":"2024-04-25T13:41:04.417831+0000","last_became_peered":"2024-04-25T13:41:04.417831+0000","last_unstale":"2024-04-25T13:41:05.399648+0000","last_undegraded":"2024-04-25T13:41:05.399648+0000","last_fullsized":"2024-04-25T13:41:05.399648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376400+0000","last_change":"2024-04-25T13:41:03.424206+0000","last_active":"2024-04-25T13:41:06.376400+0000","last_peered":"2024-04-25T13:41:06.376400+0000","last_clean":"2024-04-25T13:41:06.376400+0000","last_became_active":"2024-04-25T13:41:03.423176+0000","last_became_peered":"2024-04-25T13:41:03.423176+0000","last_unstale":"2024-04-25T13:41:06.376400+0000","last_undegraded":"2024-04-25T13:41:06.376400+0000","last_fullsized":"2024-04-25T13:41:06.376400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:23.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394828+0000","last_change":"2024-04-25T13:41:04.402353+0000","last_active":"2024-04-25T13:41:05.394828+0000","last_peered":"2024-04-25T13:41:05.394828+0000","last_clean":"2024-04-25T13:41:05.394828+0000","last_became_active":"2024-04-25T13:41:04.402014+0000","last_became_peered":"2024-04-25T13:41:04.402014+0000","last_unstale":"2024-04-25T13:41:05.394828+0000","last_undegraded":"2024-04-25T13:41:05.394828+0000","last_fullsized":"2024-04-25T13:41:05.394828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394770+0000","last_change":"2024-04-25T13:41:03.439449+0000","last_active":"2024-04-25T13:41:05.394770+0000","last_peered":"2024-04-25T13:41:05.394770+0000","last_clean":"2024-04-25T13:41:05.394770+0000","last_became_active":"2024-04-25T13:41:03.439074+0000","last_became_peered":"2024-04-25T13:41:03.439074+0000","last_unstale":"2024-04-25T13:41:05.394770+0000","last_undegraded":"2024-04-25T13:41:05.394770+0000","last_fullsized":"2024-04-25T13:41:05.394770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272770+0000","last_change":"2024-04-25T13:41:04.418630+0000","last_active":"2024-04-25T13:41:06.272770+0000","last_peered":"2024-04-25T13:41:06.272770+0000","last_clean":"2024-04-25T13:41:06.272770+0000","last_became_active":"2024-04-25T13:41:04.418330+0000","last_became_peered":"2024-04-25T13:41:04.418330+0000","last_unstale":"2024-04-25T13:41:06.272770+0000","last_undegraded":"2024-04-25T13:41:06.272770+0000","last_fullsized":"2024-04-25T13:41:06.272770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083247+0000","last_change":"2024-04-25T13:41:03.435851+0000","last_active":"2024-04-25T13:41:07.083247+0000","last_peered":"2024-04-25T13:41:07.083247+0000","last_clean":"2024-04-25T13:41:07.083247+0000","last_became_active":"2024-04-25T13:41:03.434870+0000","last_became_peered":"2024-04-25T13:41:03.434870+0000","last_unstale":"2024-04-25T13:41:07.083247+0000","last_undegraded":"2024-04-25T13:41:07.083247+0000","last_fullsized":"2024-04-25T13:41:07.083247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080993+0000","last_change":"2024-04-25T13:41:04.426962+0000","last_active":"2024-04-25T13:41:07.080993+0000","last_peered":"2024-04-25T13:41:07.080993+0000","last_clean":"2024-04-25T13:41:07.080993+0000","last_became_active":"2024-04-25T13:41:04.426424+0000","last_became_peered":"2024-04-25T13:41:04.426424+0000","last_unstale":"2024-04-25T13:41:07.080993+0000","last_undegraded":"2024-04-25T13:41:07.080993+0000","last_fullsized":"2024-04-25T13:41:07.080993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.374720+0000","last_change":"2024-04-25T13:41:03.430095+0000","last_active":"2024-04-25T13:41:06.374720+0000","last_peered":"2024-04-25T13:41:06.374720+0000","last_clean":"2024-04-25T13:41:06.374720+0000","last_became_active":"2024-04-25T13:41:03.429094+0000","last_became_peered":"2024-04-25T13:41:03.429094+0000","last_unstale":"2024-04-25T13:41:06.374720+0000","last_undegraded":"2024-04-25T13:41:06.374720+0000","last_fullsized":"2024-04-25T13:41:06.374720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083934+0000","last_change":"2024-04-25T13:41:04.413097+0000","last_active":"2024-04-25T13:41:07.083934+0000","last_peered":"2024-04-25T13:41:07.083934+0000","last_clean":"2024-04-25T13:41:07.083934+0000","last_became_active":"2024-04-25T13:41:04.412572+0000","last_became_peered":"2024-04-25T13:41:04.412572+0000","last_unstale":"2024-04-25T13:41:07.083934+0000","last_undegraded":"2024-04-25T13:41:07.083934+0000","last_fullsized":"2024-04-25T13:41:07.083934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:50.740570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394078+0000","last_change":"2024-04-25T13:41:03.411890+0000","last_active":"2024-04-25T13:41:05.394078+0000","last_peered":"2024-04-25T13:41:05.394078+0000","last_clean":"2024-04-25T13:41:05.394078+0000","last_became_active":"2024-04-25T13:41:03.411481+0000","last_became_peered":"2024-04-25T13:41:03.411481+0000","last_unstale":"2024-04-25T13:41:05.394078+0000","last_undegraded":"2024-04-25T13:41:05.394078+0000","last_fullsized":"2024-04-25T13:41:05.394078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272095+0000","last_change":"2024-04-25T13:41:04.408896+0000","last_active":"2024-04-25T13:41:06.272095+0000","last_peered":"2024-04-25T13:41:06.272095+0000","last_clean":"2024-04-25T13:41:06.272095+0000","last_became_active":"2024-04-25T13:41:04.408517+0000","last_became_peered":"2024-04-25T13:41:04.408517+0000","last_unstale":"2024-04-25T13:41:06.272095+0000","last_undegraded":"2024-04-25T13:41:06.272095+0000","last_fullsized":"2024-04-25T13:41:06.272095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394550+0000","last_change":"2024-04-25T13:41:03.408129+0000","last_active":"2024-04-25T13:41:05.394550+0000","last_peered":"2024-04-25T13:41:05.394550+0000","last_clean":"2024-04-25T13:41:05.394550+0000","last_became_active":"2024-04-25T13:41:03.407713+0000","last_became_peered":"2024-04-25T13:41:03.407713+0000","last_unstale":"2024-04-25T13:41:05.394550+0000","last_undegraded":"2024-04-25T13:41:05.394550+0000","last_fullsized":"2024-04-25T13:41:05.394550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272097+0000","last_change":"2024-04-25T13:41:04.424601+0000","last_active":"2024-04-25T13:41:06.272097+0000","last_peered":"2024-04-25T13:41:06.272097+0000","last_clean":"2024-04-25T13:41:06.272097+0000","last_became_active":"2024-04-25T13:41:04.424153+0000","last_became_peered":"2024-04-25T13:41:04.424153+0000","last_unstale":"2024-04-25T13:41:06.272097+0000","last_undegraded":"2024-04-25T13:41:06.272097+0000","last_fullsized":"2024-04-25T13:41:06.272097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375586+0000","last_change":"2024-04-25T13:41:03.431525+0000","last_active":"2024-04-25T13:41:06.375586+0000","last_peered":"2024-04-25T13:41:06.375586+0000","last_clean":"2024-04-25T13:41:06.375586+0000","last_became_active":"2024-04-25T13:41:03.430716+0000","last_became_peered":"2024-04-25T13:41:03.430716+0000","last_unstale":"2024-04-25T13:41:06.375586+0000","last_undegraded":"2024-04-25T13:41:06.375586+0000","last_fullsized":"2024-04-25T13:41:06.375586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:46.480379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081813+0000","last_change":"2024-04-25T13:41:04.424614+0000","last_active":"2024-04-25T13:41:07.081813+0000","last_peered":"2024-04-25T13:41:07.081813+0000","last_clean":"2024-04-25T13:41:07.081813+0000","last_became_active":"2024-04-25T13:41:04.424248+0000","last_became_peered":"2024-04-25T13:41:04.424248+0000","last_unstale":"2024-04-25T13:41:07.081813+0000","last_undegraded":"2024-04-25T13:41:07.081813+0000","last_fullsized":"2024-04-25T13:41:07.081813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399200+0000","last_change":"2024-04-25T13:41:04.425893+0000","last_active":"2024-04-25T13:41:05.399200+0000","last_peered":"2024-04-25T13:41:05.399200+0000","last_clean":"2024-04-25T13:41:05.399200+0000","last_became_active":"2024-04-25T13:41:04.424475+0000","last_became_peered":"2024-04-25T13:41:04.424475+0000","last_unstale":"2024-04-25T13:41:05.399200+0000","last_undegraded":"2024-04-25T13:41:05.399200+0000","last_fullsized":"2024-04-25T13:41:05.399200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375539+0000","last_change":"2024-04-25T13:41:03.447296+0000","last_active":"2024-04-25T13:41:06.375539+0000","last_peered":"2024-04-25T13:41:06.375539+0000","last_clean":"2024-04-25T13:41:06.375539+0000","last_became_active":"2024-04-25T13:41:03.446522+0000","last_became_peered":"2024-04-25T13:41:03.446522+0000","last_unstale":"2024-04-25T13:41:06.375539+0000","last_undegraded":"2024-04-25T13:41:06.375539+0000","last_fullsized":"2024-04-25T13:41:06.375539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398474+0000","last_change":"2024-04-25T13:41:04.424211+0000","last_active":"2024-04-25T13:41:05.398474+0000","last_peered":"2024-04-25T13:41:05.398474+0000","last_clean":"2024-04-25T13:41:05.398474+0000","last_became_active":"2024-04-25T13:41:04.423899+0000","last_became_peered":"2024-04-25T13:41:04.423899+0000","last_unstale":"2024-04-25T13:41:05.398474+0000","last_undegraded":"2024-04-25T13:41:05.398474+0000","last_fullsized":"2024-04-25T13:41:05.398474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376048+0000","last_change":"2024-04-25T13:41:03.441717+0000","last_active":"2024-04-25T13:41:06.376048+0000","last_peered":"2024-04-25T13:41:06.376048+0000","last_clean":"2024-04-25T13:41:06.376048+0000","last_became_active":"2024-04-25T13:41:03.440886+0000","last_became_peered":"2024-04-25T13:41:03.440886+0000","last_unstale":"2024-04-25T13:41:06.376048+0000","last_undegraded":"2024-04-25T13:41:06.376048+0000","last_fullsized":"2024-04-25T13:41:06.376048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081156+0000","last_change":"2024-04-25T13:41:04.423577+0000","last_active":"2024-04-25T13:41:07.081156+0000","last_peered":"2024-04-25T13:41:07.081156+0000","last_clean":"2024-04-25T13:41:07.081156+0000","last_became_active":"2024-04-25T13:41:04.422496+0000","last_became_peered":"2024-04-25T13:41:04.422496+0000","last_unstale":"2024-04-25T13:41:07.081156+0000","last_undegraded":"2024-04-25T13:41:07.081156+0000","last_fullsized":"2024-04-25T13:41:07.081156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272735+0000","last_change":"2024-04-25T13:41:03.418067+0000","last_active":"2024-04-25T13:41:06.272735+0000","last_peered":"2024-04-25T13:41:06.272735+0000","last_clean":"2024-04-25T13:41:06.272735+0000","last_became_active":"2024-04-25T13:41:03.417592+0000","last_became_peered":"2024-04-25T13:41:03.417592+0000","last_unstale":"2024-04-25T13:41:06.272735+0000","last_undegraded":"2024-04-25T13:41:06.272735+0000","last_fullsized":"2024-04-25T13:41:06.272735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272712+0000","last_change":"2024-04-25T13:41:04.410387+0000","last_active":"2024-04-25T13:41:06.272712+0000","last_peered":"2024-04-25T13:41:06.272712+0000","last_clean":"2024-04-25T13:41:06.272712+0000","last_became_active":"2024-04-25T13:41:04.410065+0000","last_became_peered":"2024-04-25T13:41:04.410065+0000","last_unstale":"2024-04-25T13:41:06.272712+0000","last_undegraded":"2024-04-25T13:41:06.272712+0000","last_fullsized":"2024-04-25T13:41:06.272712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081075+0000","last_change":"2024-04-25T13:41:03.425103+0000","last_active":"2024-04-25T13:41:07.081075+0000","last_peered":"2024-04-25T13:41:07.081075+0000","last_clean":"2024-04-25T13:41:07.081075+0000","last_became_active":"2024-04-25T13:41:03.424688+0000","last_became_peered":"2024-04-25T13:41:03.424688+0000","last_unstale":"2024-04-25T13:41:07.081075+0000","last_undegraded":"2024-04-25T13:41:07.081075+0000","last_fullsized":"2024-04-25T13:41:07.081075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:51.359222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":666555,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":666611,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:41:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T13:41:08.895 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T13:41:08.895 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T13:41:08.895 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T13:41:08.895 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T13:41:09.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b74c34640 1 Processor -- start 2024-04-25T13:41:09.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b74c34640 1 -- start start 2024-04-25T13:41:09.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b74c34640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8b700b85f0 0x7f8b70146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b74c34640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b70071d10 con 0x7f8b70073bc0 2024-04-25T13:41:09.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b74c34640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b70150ff0 con 0x7f8b70071900 2024-04-25T13:41:09.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b74c34640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f8b700733c0 con 0x7f8b700b85f0 2024-04-25T13:41:09.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8b70073bc0 0x7f8b70073fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42718/0 (socket says 172.21.15.77:42718) 2024-04-25T13:41:09.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6ed9d640 1 -- 172.21.15.77:0/929655423 learned_addr learned my addr 172.21.15.77:0/929655423 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:09.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6e59c640 1 --2- 172.21.15.77:0/929655423 >> v2:172.21.15.96:3300/0 conn(0x7f8b700b85f0 0x7f8b70146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257138595 0 0) 0x7f8b70071d10 con 0x7f8b70073bc0 2024-04-25T13:41:09.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b58003530 con 0x7f8b70073bc0 2024-04-25T13:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2105649174 0 0) 0x7f8b58003530 con 0x7f8b70073bc0 2024-04-25T13:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 >> v2:172.21.15.96:3300/0 conn(0x7f8b700b85f0 msgr2=0x7f8b70146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 --2- 172.21.15.77:0/929655423 >> v2:172.21.15.96:3300/0 conn(0x7f8b700b85f0 0x7f8b70146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 >> v1:172.21.15.96:6789/0 conn(0x7f8b70071900 legacy=0x7f8b7006f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b700736a0 con 0x7f8b70073bc0 2024-04-25T13:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f8b68001a00 con 0x7f8b70073bc0 2024-04-25T13:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 >> v1:172.21.15.77:6789/0 conn(0x7f8b70073bc0 legacy=0x7f8b70073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580039c0 0x7f8b58003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004810 0x7f8b58004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b58005260 0x7f8b5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b700733c0 con 0x7f8b580039c0 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5800c1f0 con 0x7f8b58004810 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5800c3f0 con 0x7f8b58005260 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.083+0000 7f8b6e59c640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580039c0 0x7f8b58003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6ed9d640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b58005260 0x7f8b5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6dd9b640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004810 0x7f8b58004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6e59c640 1 -- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b58005260 msgr2=0x7f8b5800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6e59c640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b58005260 0x7f8b5800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6e59c640 1 -- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004810 msgr2=0x7f8b58004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6e59c640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004810 0x7f8b58004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6e59c640 1 -- 172.21.15.77:0/929655423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b58003530 con 0x7f8b580039c0 2024-04-25T13:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6ed9d640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b58005260 0x7f8b5800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:09.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6dd9b640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004810 0x7f8b58004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:09.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6ed9d640 1 -- 172.21.15.77:0/929655423 reap_dead start 2024-04-25T13:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6e59c640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580039c0 0x7f8b58003e30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b700c1370 tx=0x7f8b6001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7307a093a761a35f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b600ac070 con 0x7f8b580039c0 2024-04-25T13:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b600059a0 con 0x7f8b580039c0 2024-04-25T13:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b6d59a640 1 -- 172.21.15.77:0/929655423 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60009690 con 0x7f8b580039c0 2024-04-25T13:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b74c34640 1 -- 172.21.15.77:0/929655423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580039c0 msgr2=0x7f8b58003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b74c34640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580039c0 0x7f8b58003e30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b700c1370 tx=0x7f8b6001c990 comp rx=0 tx=0).stop 2024-04-25T13:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b74c34640 1 -- 172.21.15.77:0/929655423 shutdown_connections 2024-04-25T13:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b74c34640 1 --2- 172.21.15.77:0/929655423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b580039c0 0x7f8b58003e30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b74c34640 1 -- 172.21.15.77:0/929655423 >> 172.21.15.77:0/929655423 conn(0x7f8b700c02a0 msgr2=0x7f8b700c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:09.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b74c34640 1 -- 172.21.15.77:0/929655423 shutdown_connections 2024-04-25T13:41:09.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.087+0000 7f8b74c34640 1 -- 172.21.15.77:0/929655423 wait complete. 2024-04-25T13:41:09.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 Processor -- start 2024-04-25T13:41:09.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 -- start start 2024-04-25T13:41:09.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b580039c0 0x7f8b70142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b70142a70 0x7f8b700bc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700bcd70 0x7f8b701e97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b70074150 con 0x7f8b700bcd70 2024-04-25T13:41:09.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8b70073fd0 con 0x7f8b580039c0 2024-04-25T13:41:09.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f8b700742d0 con 0x7f8b70142a70 2024-04-25T13:41:09.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700bcd70 0x7f8b701e97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700bcd70 0x7f8b701e97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36110/0 (socket says 172.21.15.77:36110) 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6ed9d640 1 -- 172.21.15.77:0/2489919112 learned_addr learned my addr 172.21.15.77:0/2489919112 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6dd9b640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b70142a70 0x7f8b700bc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6e59c640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b580039c0 0x7f8b70142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6ed9d640 1 -- 172.21.15.77:0/2489919112 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b70142a70 msgr2=0x7f8b700bc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6ed9d640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b70142a70 0x7f8b700bc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6ed9d640 1 -- 172.21.15.77:0/2489919112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b580039c0 msgr2=0x7f8b70142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6ed9d640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b580039c0 0x7f8b70142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6ed9d640 1 -- 172.21.15.77:0/2489919112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b700be2f0 con 0x7f8b700bcd70 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b6ed9d640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700bcd70 0x7f8b701e97c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b700c1250 tx=0x7f8b6800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b5effd640 1 -- 172.21.15.77:0/2489919112 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68004d70 con 0x7f8b700bcd70 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b5effd640 1 -- 172.21.15.77:0/2489919112 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6800bb20 con 0x7f8b700bcd70 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b700be530 con 0x7f8b700bcd70 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b5effd640 1 -- 172.21.15.77:0/2489919112 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68007070 con 0x7f8b700bcd70 2024-04-25T13:41:09.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.091+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b700bee00 con 0x7f8b700bcd70 2024-04-25T13:41:09.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.095+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7006a280 con 0x7f8b700bcd70 2024-04-25T13:41:09.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.095+0000 7f8b5effd640 1 -- 172.21.15.77:0/2489919112 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8b68007210 con 0x7f8b700bcd70 2024-04-25T13:41:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.095+0000 7f8b5effd640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b5006f430 0x7f8b50071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.095+0000 7f8b5effd640 1 -- 172.21.15.77:0/2489919112 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8b6808f110 con 0x7f8b700bcd70 2024-04-25T13:41:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.095+0000 7f8b6e59c640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b5006f430 0x7f8b50071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.095+0000 7f8b6e59c640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b5006f430 0x7f8b50071940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b600ab000 tx=0x7f8b60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.099+0000 7f8b5effd640 1 -- 172.21.15.77:0/2489919112 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b6805c000 con 0x7f8b700bcd70 2024-04-25T13:41:09.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.283+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8b70143210 con 0x7f8b700bcd70 2024-04-25T13:41:09.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.287+0000 7f8b5effd640 1 -- 172.21.15.77:0/2489919112 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+179545 (secure 0 0 0) 0x7f8b6805b900 con 0x7f8b700bcd70 2024-04-25T13:41:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b5006f430 msgr2=0x7f8b50071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b5006f430 0x7f8b50071940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b600ab000 tx=0x7f8b60008040 comp rx=0 tx=0).stop 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700bcd70 msgr2=0x7f8b701e97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700bcd70 0x7f8b701e97c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b700c1250 tx=0x7f8b6800b4a0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 shutdown_connections 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b5006f430 0x7f8b50071940 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700bcd70 0x7f8b701e97c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b70142a70 0x7f8b700bc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 --2- 172.21.15.77:0/2489919112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b580039c0 0x7f8b70142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 >> 172.21.15.77:0/2489919112 conn(0x7f8b700c02a0 msgr2=0x7f8b70072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:09.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 shutdown_connections 2024-04-25T13:41:09.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.291+0000 7f8b74c34640 1 -- 172.21.15.77:0/2489919112 wait complete. 2024-04-25T13:41:09.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:09.311 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:09.312 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4289912412},{"type":"v1","addr":"172.21.15.77:6833","nonce":4289912412}]},"active_addr":"172.21.15.77:6833/4289912412","active_change":"2024-04-25T13:40:50.351120+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":4004006069}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3473729151}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1920738992}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3271049927}]}]} 2024-04-25T13:41:09.317 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T13:41:09.317 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T13:41:09.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:09.319 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:09.322 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:09.324 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.495+0000 7f307e988640 1 Processor -- start 2024-04-25T13:41:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.495+0000 7f307e988640 1 -- start start 2024-04-25T13:41:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307e988640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f30780a93a0 0x7f30780a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307e988640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3078151fe0 0x7f30781523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307e988640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3078152930 0x7f307814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307e988640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f30780a97b0 con 0x7f3078152930 2024-04-25T13:41:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307e988640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f3078073ed0 con 0x7f30780a93a0 2024-04-25T13:41:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307e988640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f3078074380 con 0x7f3078151fe0 2024-04-25T13:41:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307cf25640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3078152930 0x7f307814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307cf25640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3078152930 0x7f307814dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36122/0 (socket says 172.21.15.77:36122) 2024-04-25T13:41:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307cf25640 1 -- 172.21.15.77:0/2687388087 learned_addr learned my addr 172.21.15.77:0/2687388087 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307cf25640 1 -- 172.21.15.77:0/2687388087 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3078151fe0 msgr2=0x7f30781523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f306ffff640 1 --2- 172.21.15.77:0/2687388087 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3078151fe0 0x7f30781523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307cf25640 1 --2- 172.21.15.77:0/2687388087 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3078151fe0 0x7f30781523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f3077fff640 1 --2- 172.21.15.77:0/2687388087 >> v2:172.21.15.96:3300/0 conn(0x7f30780a93a0 0x7f30780a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307cf25640 1 -- 172.21.15.77:0/2687388087 >> v2:172.21.15.96:3300/0 conn(0x7f30780a93a0 msgr2=0x7f30780a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307cf25640 1 --2- 172.21.15.77:0/2687388087 >> v2:172.21.15.96:3300/0 conn(0x7f30780a93a0 0x7f30780a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307cf25640 1 -- 172.21.15.77:0/2687388087 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30780a8020 con 0x7f3078152930 2024-04-25T13:41:09.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f307cf25640 1 --2- 172.21.15.77:0/2687388087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078152930 0x7f307814dea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3078070df0 tx=0x7f307001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3309c682c1692285 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:09.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f30777fe640 1 -- 172.21.15.77:0/2687388087 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30700a55c0 con 0x7f3078152930 2024-04-25T13:41:09.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f30777fe640 1 -- 172.21.15.77:0/2687388087 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30700a5760 con 0x7f3078152930 2024-04-25T13:41:09.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.499+0000 7f30777fe640 1 -- 172.21.15.77:0/2687388087 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30700a5b30 con 0x7f3078152930 2024-04-25T13:41:09.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 -- 172.21.15.77:0/2687388087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078152930 msgr2=0x7f307814dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 --2- 172.21.15.77:0/2687388087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078152930 0x7f307814dea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3078070df0 tx=0x7f307001c8b0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 -- 172.21.15.77:0/2687388087 shutdown_connections 2024-04-25T13:41:09.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 --2- 172.21.15.77:0/2687388087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078152930 0x7f307814dea0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 --2- 172.21.15.77:0/2687388087 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3078151fe0 0x7f30781523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 --2- 172.21.15.77:0/2687388087 >> v2:172.21.15.96:3300/0 conn(0x7f30780a93a0 0x7f30780a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 -- 172.21.15.77:0/2687388087 >> 172.21.15.77:0/2687388087 conn(0x7f30780c02a0 msgr2=0x7f30780c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:09.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 -- 172.21.15.77:0/2687388087 shutdown_connections 2024-04-25T13:41:09.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 -- 172.21.15.77:0/2687388087 wait complete. 2024-04-25T13:41:09.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 Processor -- start 2024-04-25T13:41:09.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 -- start start 2024-04-25T13:41:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f30780a93a0 0x7f307814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078151fe0 0x7f30781431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3078152930 0x7f307814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f307814e3e0 con 0x7f3078151fe0 2024-04-25T13:41:09.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f30780a8510 con 0x7f3078152930 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307e988640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f307814e560 con 0x7f30780a93a0 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f306ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078151fe0 0x7f30781431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f306ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078151fe0 0x7f30781431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36124/0 (socket says 172.21.15.77:36124) 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f306ffff640 1 -- 172.21.15.77:0/2734745533 learned_addr learned my addr 172.21.15.77:0/2734745533 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f3077fff640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f30780a93a0 0x7f307814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f307cf25640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3078152930 0x7f307814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f306ffff640 1 -- 172.21.15.77:0/2734745533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f30780a93a0 msgr2=0x7f307814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f306ffff640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f30780a93a0 0x7f307814c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f306ffff640 1 -- 172.21.15.77:0/2734745533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3078152930 msgr2=0x7f307814fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f306ffff640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3078152930 0x7f307814fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.503+0000 7f306ffff640 1 -- 172.21.15.77:0/2734745533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307814d110 con 0x7f3078151fe0 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f306ffff640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078151fe0 0x7f30781431b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f306000c5a0 tx=0x7f306000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f30757fa640 1 -- 172.21.15.77:0/2734745533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060015070 con 0x7f3078151fe0 2024-04-25T13:41:09.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f30757fa640 1 -- 172.21.15.77:0/2734745533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3060004220 con 0x7f3078151fe0 2024-04-25T13:41:09.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f30757fa640 1 -- 172.21.15.77:0/2734745533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060003620 con 0x7f3078151fe0 2024-04-25T13:41:09.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307814d3f0 con 0x7f3078151fe0 2024-04-25T13:41:09.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3078150bc0 con 0x7f3078151fe0 2024-04-25T13:41:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307806a280 con 0x7f3078151fe0 2024-04-25T13:41:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f30757fa640 1 -- 172.21.15.77:0/2734745533 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f30600037c0 con 0x7f3078151fe0 2024-04-25T13:41:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f30757fa640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f305806f400 0x7f3058071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f3077fff640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f305806f400 0x7f3058071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f30757fa640 1 -- 172.21.15.77:0/2734745533 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f306008eff0 con 0x7f3078151fe0 2024-04-25T13:41:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.507+0000 7f3077fff640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f305806f400 0x7f3058071910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3068006fd0 tx=0x7f3068008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:09.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.511+0000 7f30757fa640 1 -- 172.21.15.77:0/2734745533 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f306005bee0 con 0x7f3078151fe0 2024-04-25T13:41:09.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.675+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3078074780 con 0x7f3078151fe0 2024-04-25T13:41:09.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.675+0000 7f30757fa640 1 -- 172.21.15.77:0/2734745533 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7f306005b7e0 con 0x7f3078151fe0 2024-04-25T13:41:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:09.677 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:05.383876+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.675+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f305806f400 msgr2=0x7f3058071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.675+0000 7f307e988640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f305806f400 0x7f3058071910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3068006fd0 tx=0x7f3068008040 comp rx=0 tx=0).stop 2024-04-25T13:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.675+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078151fe0 msgr2=0x7f30781431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.675+0000 7f307e988640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078151fe0 0x7f30781431b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f306000c5a0 tx=0x7f306000ca60 comp rx=0 tx=0).stop 2024-04-25T13:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.679+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 shutdown_connections 2024-04-25T13:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.679+0000 7f307e988640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f305806f400 0x7f3058071910 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.679+0000 7f307e988640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3078152930 0x7f307814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.679+0000 7f307e988640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3078151fe0 0x7f30781431b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.679+0000 7f307e988640 1 --2- 172.21.15.77:0/2734745533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f30780a93a0 0x7f307814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.679+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 >> 172.21.15.77:0/2734745533 conn(0x7f30780c02a0 msgr2=0x7f30781383f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:09.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.679+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 shutdown_connections 2024-04-25T13:41:09.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.679+0000 7f307e988640 1 -- 172.21.15.77:0/2734745533 wait complete. 2024-04-25T13:41:09.698 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T13:41:09.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca13f24640 1 Processor -- start 2024-04-25T13:41:09.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca13f24640 1 -- start start 2024-04-25T13:41:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca13f24640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca0c146cb0 0x7fca0c071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca13f24640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca0c073bc0 0x7fca0c073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca13f24640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca0c1470c0 con 0x7fca0c0b85f0 2024-04-25T13:41:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca13f24640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fca0c074510 con 0x7fca0c146cb0 2024-04-25T13:41:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca13f24640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fca0c150ff0 con 0x7fca0c073bc0 2024-04-25T13:41:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca11cc0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fca0c0b85f0 0x7fca0c06f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42722/0 (socket says 172.21.15.77:42722) 2024-04-25T13:41:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca11cc0640 1 -- 172.21.15.77:0/565367486 learned_addr learned my addr 172.21.15.77:0/565367486 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca124c1640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca0c073bc0 0x7fca0c073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca114bf640 1 --2- 172.21.15.77:0/565367486 >> v2:172.21.15.96:3300/0 conn(0x7fca0c146cb0 0x7fca0c071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3070044528 0 0) 0x7fca0c1470c0 con 0x7fca0c0b85f0 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9f8003530 con 0x7fca0c0b85f0 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 921303303 0 0) 0x7fc9f8003530 con 0x7fca0c0b85f0 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca0c073bc0 msgr2=0x7fca0c073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca0c073bc0 0x7fca0c073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 >> v2:172.21.15.96:3300/0 conn(0x7fca0c146cb0 msgr2=0x7fca0c071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 --2- 172.21.15.77:0/565367486 >> v2:172.21.15.96:3300/0 conn(0x7fca0c146cb0 0x7fca0c071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c0733c0 con 0x7fca0c0b85f0 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fca08001800 con 0x7fca0c0b85f0 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 >> v1:172.21.15.77:6789/0 conn(0x7fca0c0b85f0 legacy=0x7fca0c06f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca0c073bc0 0x7fc9f80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f8003f40 0x7fc9f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f8004d50 0x7fc9f8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c074510 con 0x7fc9f8003f40 2024-04-25T13:41:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c150ff0 con 0x7fc9f8004d50 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f800bad0 con 0x7fca0c073bc0 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca114bf640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f8003f40 0x7fc9f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca11cc0640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca0c073bc0 0x7fc9f80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca124c1640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f8004d50 0x7fc9f8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca114bf640 1 -- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca0c073bc0 msgr2=0x7fc9f80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca114bf640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca0c073bc0 0x7fc9f80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca114bf640 1 -- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f8004d50 msgr2=0x7fc9f8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca114bf640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f8004d50 0x7fc9f8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.843+0000 7fca114bf640 1 -- 172.21.15.77:0/565367486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f8003530 con 0x7fc9f8003f40 2024-04-25T13:41:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca114bf640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f8003f40 0x7fc9f8004810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009ae0 tx=0x7fc9fc01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a49570960becaed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0b2070 con 0x7fc9f8003f40 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc0a5560 con 0x7fc9f8003f40 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca10cbe640 1 -- 172.21.15.77:0/565367486 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0096b0 con 0x7fc9f8003f40 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca13f24640 1 -- 172.21.15.77:0/565367486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f8003f40 msgr2=0x7fc9f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca13f24640 1 --2- 172.21.15.77:0/565367486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f8003f40 0x7fc9f8004810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009ae0 tx=0x7fc9fc01ca80 comp rx=0 tx=0).stop 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca124c1640 1 -- 172.21.15.77:0/565367486 reap_dead start 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca13f24640 1 -- 172.21.15.77:0/565367486 shutdown_connections 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca13f24640 1 -- 172.21.15.77:0/565367486 >> 172.21.15.77:0/565367486 conn(0x7fca0c0c02a0 msgr2=0x7fca0c0c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca13f24640 1 -- 172.21.15.77:0/565367486 shutdown_connections 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.847+0000 7fca13f24640 1 -- 172.21.15.77:0/565367486 wait complete. 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 Processor -- start 2024-04-25T13:41:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 -- start start 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9f8003f40 0x7fca0c1ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca0c149130 0x7fca0c152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca0c152660 0x7fca0c1476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c15b530 con 0x7fca0c152660 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c15b3b0 con 0x7fca0c149130 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fca0c15b6b0 con 0x7fc9f8003f40 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca124c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca0c152660 0x7fca0c1476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca124c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca0c152660 0x7fca0c1476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36134/0 (socket says 172.21.15.77:36134) 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca124c1640 1 -- 172.21.15.77:0/1946512034 learned_addr learned my addr 172.21.15.77:0/1946512034 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca11cc0640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9f8003f40 0x7fca0c1ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca114bf640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca0c149130 0x7fca0c152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca124c1640 1 -- 172.21.15.77:0/1946512034 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9f8003f40 msgr2=0x7fca0c1ecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca124c1640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9f8003f40 0x7fca0c1ecb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca124c1640 1 -- 172.21.15.77:0/1946512034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca0c149130 msgr2=0x7fca0c152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca124c1640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca0c149130 0x7fca0c152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca124c1640 1 -- 172.21.15.77:0/1946512034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c14a4f0 con 0x7fca0c152660 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca114bf640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca0c149130 0x7fca0c152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca124c1640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca0c152660 0x7fca0c1476f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0c1250 tx=0x7fca040115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca027fc640 1 -- 172.21.15.77:0/1946512034 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04011e40 con 0x7fca0c152660 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca027fc640 1 -- 172.21.15.77:0/1946512034 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0401b070 con 0x7fca0c152660 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0c1ed560 con 0x7fca0c152660 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca027fc640 1 -- 172.21.15.77:0/1946512034 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca040039a0 con 0x7fca0c152660 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0c152df0 con 0x7fca0c152660 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca0c1474a0 con 0x7fca0c152660 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.851+0000 7fca027fc640 1 -- 172.21.15.77:0/1946512034 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fca04003b40 con 0x7fca0c152660 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.855+0000 7fca027fc640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc9f006f400 0x7fc9f0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.855+0000 7fca027fc640 1 -- 172.21.15.77:0/1946512034 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fca0408f900 con 0x7fca0c152660 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.855+0000 7fca11cc0640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc9f006f400 0x7fc9f0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.855+0000 7fca11cc0640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc9f006f400 0x7fc9f0071910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca08001ec0 tx=0x7fca08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:09.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:09.859+0000 7fca027fc640 1 -- 172.21.15.77:0/1946512034 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca0405c7f0 con 0x7fca0c152660 2024-04-25T13:41:10.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.019+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca0c1ed730 con 0x7fca0c152660 2024-04-25T13:41:10.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.023+0000 7fca027fc640 1 -- 172.21.15.77:0/1946512034 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7fca0405c0f0 con 0x7fca0c152660 2024-04-25T13:41:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:10.026 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:05.383876+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc9f006f400 msgr2=0x7fc9f0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc9f006f400 0x7fc9f0071910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca08001ec0 tx=0x7fca08009040 comp rx=0 tx=0).stop 2024-04-25T13:41:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca0c152660 msgr2=0x7fca0c1476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca0c152660 0x7fca0c1476f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0c1250 tx=0x7fca040115a0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 shutdown_connections 2024-04-25T13:41:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc9f006f400 0x7fc9f0071910 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca0c152660 0x7fca0c1476f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca0c149130 0x7fca0c152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 --2- 172.21.15.77:0/1946512034 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9f8003f40 0x7fca0c1ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 >> 172.21.15.77:0/1946512034 conn(0x7fca0c0c02a0 msgr2=0x7fca0c0c1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 shutdown_connections 2024-04-25T13:41:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.027+0000 7fca13f24640 1 -- 172.21.15.77:0/1946512034 wait complete. 2024-04-25T13:41:10.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T13:41:10.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T13:41:10.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T13:41:10.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T13:41:10.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T13:41:10.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T13:41:10.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T13:41:10.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T13:41:10.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f2943fff640 1 Processor -- start 2024-04-25T13:41:10.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f3832d8f640 1 Processor -- start 2024-04-25T13:41:10.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f71e4f63640 1 Processor -- start 2024-04-25T13:41:10.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f2943fff640 1 -- start start 2024-04-25T13:41:10.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f71e4f63640 1 -- start start 2024-04-25T13:41:10.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f77c1449640 1 Processor -- start 2024-04-25T13:41:10.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f3832d8f640 1 -- start start 2024-04-25T13:41:10.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f77c1449640 1 -- start start 2024-04-25T13:41:10.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f1a9a8a6640 1 Processor -- start 2024-04-25T13:41:10.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f1a9a8a6640 1 -- start start 2024-04-25T13:41:10.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f73af59e640 1 Processor -- start 2024-04-25T13:41:10.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f71e4f63640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f71d8046230 0x7f71d80417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f71e4f63640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f71d80d1ee0 0x7f71d80d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f71e4f63640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d80d6420 con 0x7f71d8006660 2024-04-25T13:41:10.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f71e4f63640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f71d80d23f0 con 0x7f71d80d1ee0 2024-04-25T13:41:10.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f71e4f63640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f71d80d60f0 con 0x7f71d8046230 2024-04-25T13:41:10.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f2943fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f29441516b0 0x7f2944151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f2943fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2944152000 0x7f29441559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f2943fff640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29440aacd0 con 0x7f294406d6c0 2024-04-25T13:41:10.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f2943fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f29440aa960 con 0x7f29441516b0 2024-04-25T13:41:10.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f2943fff640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f29440a4e00 con 0x7f2944152000 2024-04-25T13:41:10.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f3832d8f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c0a66d0 0x7f382c073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f3832d8f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f382c150e20 con 0x7f382c149b20 2024-04-25T13:41:10.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f3832d8f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f382c150b40 con 0x7f382c06f370 2024-04-25T13:41:10.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f3832d8f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f382c074060 con 0x7f382c0a66d0 2024-04-25T13:41:10.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f73af59e640 1 -- start start 2024-04-25T13:41:10.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f77c1449640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f77bc156580 0x7f77bc156990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f77c1449640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77bc15a810 con 0x7f77bc155a60 2024-04-25T13:41:10.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f77c1449640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77bc073af0 con 0x7f77bc0c0360 2024-04-25T13:41:10.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.267+0000 7f77c1449640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f77bc0742f0 con 0x7f77bc156580 2024-04-25T13:41:10.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f71dffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f71d80d1ee0 0x7f71d80d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f29427fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f29441516b0 0x7f2944151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f29437fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2944152000 0x7f29441559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f383158c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f382c149b20 0x7f382c06ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58954/0 (socket says 172.21.15.77:58954) 2024-04-25T13:41:10.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f383158c640 1 -- 172.21.15.77:0/3160100005 learned_addr learned my addr 172.21.15.77:0/3160100005 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:10.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f71dffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f71d80d1ee0 0x7f71d80d2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:55446/0 (socket says 172.21.15.77:55446) 2024-04-25T13:41:10.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f71dffff640 1 -- 172.21.15.77:0/1255327404 learned_addr learned my addr 172.21.15.77:0/1255327404 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f77bb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f77bc155a60 0x7f77bc155e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58948/0 (socket says 172.21.15.77:58948) 2024-04-25T13:41:10.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f77bb7fe640 1 -- 172.21.15.77:0/1482048954 learned_addr learned my addr 172.21.15.77:0/1482048954 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:10.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f29427fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f29441516b0 0x7f2944151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42168/0 (socket says 172.21.15.77:42168) 2024-04-25T13:41:10.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f29427fc640 1 -- 172.21.15.77:0/1398760255 learned_addr learned my addr 172.21.15.77:0/1398760255 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f2942ffd640 1 --1- 172.21.15.77:0/1398760255 >> v1:172.21.15.96:6789/0 conn(0x7f294406d6c0 0x7f2944073b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.77:35614/0 (socket says 172.21.15.77:35614) 2024-04-25T13:41:10.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f3831d8d640 1 --2- 172.21.15.77:0/3160100005 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c0a66d0 0x7f382c073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f71df7fe640 1 --2- 172.21.15.77:0/1255327404 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f71d8046230 0x7f71d80417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f77c0c48640 1 --2- 172.21.15.77:0/1482048954 >> v2:172.21.15.96:3300/0 conn(0x7f77bc156580 0x7f77bc156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f8064a36640 1 Processor -- start 2024-04-25T13:41:10.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f3830d8b640 1 -- 172.21.15.77:0/3160100005 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277984757 0 0) 0x7f382c150e20 con 0x7f382c149b20 2024-04-25T13:41:10.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f3830d8b640 1 -- 172.21.15.77:0/3160100005 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3818003530 con 0x7f382c149b20 2024-04-25T13:41:10.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f8064a36640 1 -- start start 2024-04-25T13:41:10.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f29427fc640 1 -- 172.21.15.77:0/1398760255 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2944152000 msgr2=0x7f29441559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f29427fc640 1 --2- 172.21.15.77:0/1398760255 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2944152000 0x7f29441559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f29427fc640 1 -- 172.21.15.77:0/1398760255 >> v1:172.21.15.96:6789/0 conn(0x7f294406d6c0 legacy=0x7f2944073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f77baffd640 1 -- 172.21.15.77:0/1482048954 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224907000 0 0) 0x7f77bc15a810 con 0x7f77bc155a60 2024-04-25T13:41:10.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f2941ffb640 1 -- 172.21.15.77:0/1398760255 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2646849592 0 0) 0x7f29440aacd0 con 0x7f294406d6c0 2024-04-25T13:41:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f77baffd640 1 -- 172.21.15.77:0/1482048954 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a4003530 con 0x7f77bc155a60 2024-04-25T13:41:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f1a9a8a6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a940a5720 0x7f1a941559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f1a9a8a6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a940a43f0 con 0x7f1a940a4bf0 2024-04-25T13:41:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f1a9a8a6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a940a5000 con 0x7f1a94155f00 2024-04-25T13:41:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f1a9a8a6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f1a940a4760 con 0x7f1a940a5720 2024-04-25T13:41:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f29427fc640 1 -- 172.21.15.77:0/1398760255 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2944155ef0 con 0x7f29441516b0 2024-04-25T13:41:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7fdabd751640 1 Processor -- start 2024-04-25T13:41:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7fdabd751640 1 -- start start 2024-04-25T13:41:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f73af59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73a8041cb0 0x7f73a80de800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f73af59e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a8042d60 con 0x7f73a8007390 2024-04-25T13:41:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f73af59e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a80077a0 con 0x7f73a803a0a0 2024-04-25T13:41:10.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f73af59e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f73a80463a0 con 0x7f73a8041cb0 2024-04-25T13:41:10.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f73ae59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f73a803a0a0 0x7f73a80415a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.77:35656/0 (socket says 172.21.15.77:35656) 2024-04-25T13:41:10.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f73ae59c640 1 -- 172.21.15.77:0/1596720798 learned_addr learned my addr 172.21.15.77:0/1596720798 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:10.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f1a9a0a5640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1a94155f00 0x7f1a94159a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.77:35640/0 (socket says 172.21.15.77:35640) 2024-04-25T13:41:10.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f1a9a0a5640 1 -- 172.21.15.77:0/3839017884 learned_addr learned my addr 172.21.15.77:0/3839017884 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:10.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f77c0c48640 1 -- 172.21.15.77:0/1482048954 >> v1:172.21.15.96:6789/0 conn(0x7f77bc0c0360 legacy=0x7f77bc06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f77c0c48640 1 -- 172.21.15.77:0/1482048954 >> v1:172.21.15.77:6789/0 conn(0x7f77bc155a60 legacy=0x7f77bc155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f77c0c48640 1 -- 172.21.15.77:0/1482048954 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc15a3e0 con 0x7f77bc156580 2024-04-25T13:41:10.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f8064a36640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8058028410 0x7f805800ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f8064a36640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8058044fe0 con 0x7f8058048330 2024-04-25T13:41:10.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f8064a36640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8058043f70 con 0x7f80580d7560 2024-04-25T13:41:10.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f8064a36640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f80580d8180 con 0x7f8058028410 2024-04-25T13:41:10.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f805effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8058048330 0x7f8058043860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58982/0 (socket says 172.21.15.77:58982) 2024-04-25T13:41:10.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f805effd640 1 -- 172.21.15.77:0/909155228 learned_addr learned my addr 172.21.15.77:0/909155228 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:10.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f1a990a3640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a940a5720 0x7f1a941559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f805f7fe640 1 --2- 172.21.15.77:0/909155228 >> v2:172.21.15.96:3300/0 conn(0x7f8058028410 0x7f805800ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7fdabd751640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab814d600 0x7fdab814da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7fdabd751640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab8152590 con 0x7fdab80a8be0 2024-04-25T13:41:10.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7fdabd751640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab814e8c0 con 0x7fdab8072d90 2024-04-25T13:41:10.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7fdabd751640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fdab814f3a0 con 0x7fdab814d600 2024-04-25T13:41:10.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f3831d8d640 1 -- 172.21.15.77:0/3160100005 >> v1:172.21.15.96:6789/0 conn(0x7f382c06f370 legacy=0x7f382c15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f3831d8d640 1 -- 172.21.15.77:0/3160100005 >> v1:172.21.15.77:6789/0 conn(0x7f382c149b20 legacy=0x7f382c06ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f3831d8d640 1 -- 172.21.15.77:0/3160100005 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c06f780 con 0x7f382c0a66d0 2024-04-25T13:41:10.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f71dffff640 1 -- 172.21.15.77:0/1255327404 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f71d8046230 msgr2=0x7f71d80417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f71dffff640 1 --2- 172.21.15.77:0/1255327404 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f71d8046230 0x7f71d80417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f71dffff640 1 -- 172.21.15.77:0/1255327404 >> v1:172.21.15.77:6789/0 conn(0x7f71d8006660 legacy=0x7f71d80d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.271+0000 7f71dffff640 1 -- 172.21.15.77:0/1255327404 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d8006a70 con 0x7f71d80d1ee0 2024-04-25T13:41:10.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f805f7fe640 1 -- 172.21.15.77:0/909155228 >> v1:172.21.15.96:6789/0 conn(0x7f80580d7560 legacy=0x7f80580de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f805f7fe640 1 -- 172.21.15.77:0/909155228 >> v1:172.21.15.77:6789/0 conn(0x7f8058048330 legacy=0x7f8058043860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f805f7fe640 1 -- 172.21.15.77:0/909155228 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805800cfa0 con 0x7f8058028410 2024-04-25T13:41:10.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7fdab77fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab814d600 0x7fdab814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7fdab77fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab814d600 0x7fdab814da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:33380/0 (socket says 172.21.15.77:33380) 2024-04-25T13:41:10.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7fdab77fe640 1 -- 172.21.15.77:0/3803459520 learned_addr learned my addr 172.21.15.77:0/3803459520 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73ad59a640 1 -- 172.21.15.77:0/1596720798 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 845834433 0 0) 0x7f73a8042d60 con 0x7f73a8007390 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73ad59a640 1 -- 172.21.15.77:0/1596720798 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7398003530 con 0x7f73a8007390 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73ad59a640 1 -- 172.21.15.77:0/1596720798 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299435504 0 0) 0x7f73a80077a0 con 0x7f73a803a0a0 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968375635 0 0) 0x7f1a940a43f0 con 0x7f1a940a4bf0 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a80003530 con 0x7f1a940a4bf0 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 768409898 0 0) 0x7f1a80003530 con 0x7f1a940a4bf0 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a940a5720 msgr2=0x7f1a941559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a940a5720 0x7f1a941559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 >> v1:172.21.15.96:6789/0 conn(0x7f1a94155f00 legacy=0x7f1a94159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a940a5b30 con 0x7f1a940a4bf0 2024-04-25T13:41:10.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f1a84001680 con 0x7f1a940a4bf0 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 >> v1:172.21.15.77:6789/0 conn(0x7f1a940a4bf0 legacy=0x7f1a940a7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a800039f0 0x7f1a80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a800043a0 0x7f1a800048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 0x7f1a8000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1a940a4760 con 0x7f1a80005170 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8000c0d0 con 0x7f1a800043a0 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f1a8000c2d0 con 0x7f1a800039f0 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73add9b640 1 --2- 172.21.15.77:0/1596720798 >> v2:172.21.15.77:3300/0 conn(0x7f73a8041cb0 0x7f73a80de800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73ad59a640 1 -- 172.21.15.77:0/1596720798 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73a8042d60 con 0x7f73a803a0a0 2024-04-25T13:41:10.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71dffff640 1 --2- 172.21.15.77:0/1255327404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71d80d1ee0 0x7f71d80d2910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71e0051a60 tx=0x7f71e009b170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ecef8bf911eeb3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a9a0a5640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 0x7f1a8000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a990a3640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a800043a0 0x7f1a800048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73ad59a640 1 -- 172.21.15.77:0/1596720798 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 784812806 0 0) 0x7f7398003530 con 0x7f73a8007390 2024-04-25T13:41:10.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f29427fc640 1 --2- 172.21.15.77:0/1398760255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29441516b0 0x7f2944151ac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f293c009e50 tx=0x7f293c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9efecd1a58d08af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a998a4640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a800039f0 0x7f1a80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73add9b640 1 -- 172.21.15.77:0/1596720798 >> v1:172.21.15.96:6789/0 conn(0x7f73a803a0a0 legacy=0x7f73a80415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73add9b640 1 -- 172.21.15.77:0/1596720798 >> v1:172.21.15.77:6789/0 conn(0x7f73a8007390 legacy=0x7f73a802c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73add9b640 1 -- 172.21.15.77:0/1596720798 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a802cc20 con 0x7f73a8041cb0 2024-04-25T13:41:10.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71de7fc640 1 -- 172.21.15.77:0/1255327404 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0130070 con 0x7f71d80d1ee0 2024-04-25T13:41:10.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71de7fc640 1 -- 172.21.15.77:0/1255327404 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e012b440 con 0x7f71d80d1ee0 2024-04-25T13:41:10.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71de7fc640 1 -- 172.21.15.77:0/1255327404 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e012b8b0 con 0x7f71d80d1ee0 2024-04-25T13:41:10.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f77c0c48640 1 --2- 172.21.15.77:0/1482048954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc156580 0x7f77bc156990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009d90 tx=0x7f77b401c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89effd932e23de86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f3831d8d640 1 --2- 172.21.15.77:0/3160100005 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c0a66d0 0x7f382c073b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3824009dc0 tx=0x7f382401c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91b6193e4d90a893 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a9a0a5640 1 -- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a800039f0 msgr2=0x7f1a80003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a9a0a5640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a800039f0 0x7f1a80003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a9a0a5640 1 -- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a800043a0 msgr2=0x7f1a800048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a9a0a5640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a800043a0 0x7f1a800048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a9a0a5640 1 -- 172.21.15.77:0/3839017884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a940a5b30 con 0x7f1a80005170 2024-04-25T13:41:10.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7fdab77fe640 1 -- 172.21.15.77:0/3803459520 >> v1:172.21.15.96:6789/0 conn(0x7fdab8072d90 legacy=0x7fdab8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7fdab77fe640 1 -- 172.21.15.77:0/3803459520 >> v1:172.21.15.77:6789/0 conn(0x7fdab80a8be0 legacy=0x7fdab8151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7fdab77fe640 1 -- 172.21.15.77:0/3803459520 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab814eba0 con 0x7fdab814d600 2024-04-25T13:41:10.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f3830d8b640 1 -- 172.21.15.77:0/3160100005 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38240ac070 con 0x7f382c0a66d0 2024-04-25T13:41:10.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f3830d8b640 1 -- 172.21.15.77:0/3160100005 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38240a6430 con 0x7f382c0a66d0 2024-04-25T13:41:10.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f3830d8b640 1 -- 172.21.15.77:0/3160100005 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828001680 con 0x7f382c0a66d0 2024-04-25T13:41:10.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71e4f63640 1 -- 172.21.15.77:0/1255327404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71d80d1ee0 msgr2=0x7f71d80d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71e4f63640 1 --2- 172.21.15.77:0/1255327404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71d80d1ee0 0x7f71d80d2910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71e0051a60 tx=0x7f71e009b170 comp rx=0 tx=0).stop 2024-04-25T13:41:10.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71e4f63640 1 -- 172.21.15.77:0/1255327404 shutdown_connections 2024-04-25T13:41:10.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71e4f63640 1 --2- 172.21.15.77:0/1255327404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71d80d1ee0 0x7f71d80d2910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71e4f63640 1 --2- 172.21.15.77:0/1255327404 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f71d8046230 0x7f71d80417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71e4f63640 1 -- 172.21.15.77:0/1255327404 >> 172.21.15.77:0/1255327404 conn(0x7f71d8028f70 msgr2=0x7f71d8029380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71e4f63640 1 -- 172.21.15.77:0/1255327404 shutdown_connections 2024-04-25T13:41:10.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f805f7fe640 1 --2- 172.21.15.77:0/909155228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8058028410 0x7f805800ca60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80540097a0 tx=0x7f805401c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=218893a71509c8f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f3832d8f640 1 -- 172.21.15.77:0/3160100005 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c0a66d0 msgr2=0x7f382c073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f3832d8f640 1 --2- 172.21.15.77:0/3160100005 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c0a66d0 0x7f382c073b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3824009dc0 tx=0x7f382401c6d0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73add9b640 1 --2- 172.21.15.77:0/1596720798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a8041cb0 0x7f73a80de800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73b00660c0 tx=0x7f73b0098c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b7b822cc573319 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f2941ffb640 1 -- 172.21.15.77:0/1398760255 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c0a5810 con 0x7f29441516b0 2024-04-25T13:41:10.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f2941ffb640 1 -- 172.21.15.77:0/1398760255 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293c0a59b0 con 0x7f29441516b0 2024-04-25T13:41:10.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f2941ffb640 1 -- 172.21.15.77:0/1398760255 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c0a5d80 con 0x7f29441516b0 2024-04-25T13:41:10.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f805e7fc640 1 -- 172.21.15.77:0/909155228 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80540b0070 con 0x7f8058028410 2024-04-25T13:41:10.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f805e7fc640 1 -- 172.21.15.77:0/909155228 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80540ab600 con 0x7f8058028410 2024-04-25T13:41:10.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f805e7fc640 1 -- 172.21.15.77:0/909155228 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80540ab9d0 con 0x7f8058028410 2024-04-25T13:41:10.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f73ad59a640 1 -- 172.21.15.77:0/1596720798 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a40016a0 con 0x7f73a8041cb0 2024-04-25T13:41:10.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f1a9a0a5640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 0x7f1a8000b9d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c260 tx=0x7f1a8c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44e2348daa7f85d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.275+0000 7f71e4f63640 1 -- 172.21.15.77:0/1255327404 wait complete. 2024-04-25T13:41:10.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73ad59a640 1 -- 172.21.15.77:0/1596720798 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b0121760 con 0x7f73a8041cb0 2024-04-25T13:41:10.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77baffd640 1 -- 172.21.15.77:0/1482048954 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40b2070 con 0x7f77bc156580 2024-04-25T13:41:10.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77baffd640 1 -- 172.21.15.77:0/1482048954 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40a5830 con 0x7f77bc156580 2024-04-25T13:41:10.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77baffd640 1 -- 172.21.15.77:0/1482048954 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40a5c00 con 0x7f77bc156580 2024-04-25T13:41:10.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f2943fff640 1 -- 172.21.15.77:0/1398760255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29441516b0 msgr2=0x7f2944151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f2943fff640 1 --2- 172.21.15.77:0/1398760255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29441516b0 0x7f2944151ac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f293c009e50 tx=0x7f293c01ca50 comp rx=0 tx=0).stop 2024-04-25T13:41:10.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73af59e640 1 -- 172.21.15.77:0/1596720798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a8041cb0 msgr2=0x7f73a80de800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73af59e640 1 --2- 172.21.15.77:0/1596720798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a8041cb0 0x7f73a80de800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73b00660c0 tx=0x7f73b0098c70 comp rx=0 tx=0).stop 2024-04-25T13:41:10.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f8064a36640 1 -- 172.21.15.77:0/909155228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8058028410 msgr2=0x7f805800ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f8064a36640 1 --2- 172.21.15.77:0/909155228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8058028410 0x7f805800ca60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80540097a0 tx=0x7f805401c3b0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f8064a36640 1 -- 172.21.15.77:0/909155228 shutdown_connections 2024-04-25T13:41:10.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f8064a36640 1 --2- 172.21.15.77:0/909155228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8058028410 0x7f805800ca60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f8064a36640 1 -- 172.21.15.77:0/909155228 >> 172.21.15.77:0/909155228 conn(0x7f8058049210 msgr2=0x7f8058049620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73af59e640 1 -- 172.21.15.77:0/1596720798 shutdown_connections 2024-04-25T13:41:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73af59e640 1 --2- 172.21.15.77:0/1596720798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a8041cb0 0x7f73a80de800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73af59e640 1 -- 172.21.15.77:0/1596720798 >> 172.21.15.77:0/1596720798 conn(0x7f73a800a640 msgr2=0x7f73a800aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f2943fff640 1 -- 172.21.15.77:0/1398760255 shutdown_connections 2024-04-25T13:41:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f2943fff640 1 --2- 172.21.15.77:0/1398760255 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2944152000 0x7f29441559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f2943fff640 1 --2- 172.21.15.77:0/1398760255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29441516b0 0x7f2944151ac0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f2943fff640 1 -- 172.21.15.77:0/1398760255 >> 172.21.15.77:0/1398760255 conn(0x7f29440c56f0 msgr2=0x7f29440c5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f2943fff640 1 -- 172.21.15.77:0/1398760255 shutdown_connections 2024-04-25T13:41:10.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73af59e640 1 -- 172.21.15.77:0/1596720798 shutdown_connections 2024-04-25T13:41:10.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f8064a36640 1 -- 172.21.15.77:0/909155228 shutdown_connections 2024-04-25T13:41:10.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f2943fff640 1 -- 172.21.15.77:0/1398760255 wait complete. 2024-04-25T13:41:10.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77c1449640 1 -- 172.21.15.77:0/1482048954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc156580 msgr2=0x7f77bc156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77c1449640 1 --2- 172.21.15.77:0/1482048954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc156580 0x7f77bc156990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009d90 tx=0x7f77b401c9b0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c001fb0 con 0x7f1a80005170 2024-04-25T13:41:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c0a9070 con 0x7f1a80005170 2024-04-25T13:41:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a988a2640 1 -- 172.21.15.77:0/3839017884 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0a5c00 con 0x7f1a80005170 2024-04-25T13:41:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a9a8a6640 1 -- 172.21.15.77:0/3839017884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 msgr2=0x7f1a8000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a9a8a6640 1 --2- 172.21.15.77:0/3839017884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 0x7f1a8000b9d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c260 tx=0x7f1a8c01ccc0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77c1449640 1 -- 172.21.15.77:0/1482048954 shutdown_connections 2024-04-25T13:41:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77c1449640 1 --2- 172.21.15.77:0/1482048954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc156580 0x7f77bc156990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77c1449640 1 -- 172.21.15.77:0/1482048954 >> 172.21.15.77:0/1482048954 conn(0x7f77bc06c780 msgr2=0x7f77bc06cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a9a0a5640 1 -- 172.21.15.77:0/3839017884 reap_dead start 2024-04-25T13:41:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f8064a36640 1 -- 172.21.15.77:0/909155228 wait complete. 2024-04-25T13:41:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73af59e640 1 -- 172.21.15.77:0/1596720798 wait complete. 2024-04-25T13:41:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77c1449640 1 -- 172.21.15.77:0/1482048954 shutdown_connections 2024-04-25T13:41:10.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71e4f63640 1 Processor -- start 2024-04-25T13:41:10.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a9a8a6640 1 -- 172.21.15.77:0/3839017884 shutdown_connections 2024-04-25T13:41:10.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a9a8a6640 1 -- 172.21.15.77:0/3839017884 >> 172.21.15.77:0/3839017884 conn(0x7f1a940c3590 msgr2=0x7f1a940c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71e4f63640 1 -- start start 2024-04-25T13:41:10.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7fdab77fe640 1 --2- 172.21.15.77:0/3803459520 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab814d600 0x7fdab814da10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009e80 tx=0x7fdab001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16c7c913d1a5b4cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a9a8a6640 1 -- 172.21.15.77:0/3839017884 shutdown_connections 2024-04-25T13:41:10.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73af59e640 1 Processor -- start 2024-04-25T13:41:10.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71e4f63640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71d8006660 0x7f71d80dbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71e4f63640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f71d8046230 0x7f71d81708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71e4f63640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80d1ee0 0x7f71d803bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71e4f63640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f71d80df5c0 con 0x7f71d80d1ee0 2024-04-25T13:41:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71e4f63640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f71d80df440 con 0x7f71d8006660 2024-04-25T13:41:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71e4f63640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f71d80df740 con 0x7f71d8046230 2024-04-25T13:41:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f3832d8f640 1 -- 172.21.15.77:0/3160100005 shutdown_connections 2024-04-25T13:41:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f3832d8f640 1 --2- 172.21.15.77:0/3160100005 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c0a66d0 0x7f382c073b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f3832d8f640 1 -- 172.21.15.77:0/3160100005 >> 172.21.15.77:0/3160100005 conn(0x7f382c0c33c0 msgr2=0x7f382c0c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71dffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80d1ee0 0x7f71d803bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71dffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80d1ee0 0x7f71d803bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42186/0 (socket says 172.21.15.77:42186) 2024-04-25T13:41:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71dffff640 1 -- 172.21.15.77:0/2631944826 learned_addr learned my addr 172.21.15.77:0/2631944826 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71df7fe640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71d8006660 0x7f71d80dbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71deffd640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f71d8046230 0x7f71d81708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7fdab5ffb640 1 -- 172.21.15.77:0/3803459520 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab00a5530 con 0x7fdab814d600 2024-04-25T13:41:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7fdab5ffb640 1 -- 172.21.15.77:0/3803459520 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab00a56d0 con 0x7fdab814d600 2024-04-25T13:41:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7fdab5ffb640 1 -- 172.21.15.77:0/3803459520 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab00a5aa0 con 0x7fdab814d600 2024-04-25T13:41:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f8064a36640 1 Processor -- start 2024-04-25T13:41:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71dffff640 1 -- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f71d8046230 msgr2=0x7f71d81708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71dffff640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f71d8046230 0x7f71d81708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71dffff640 1 -- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71d8006660 msgr2=0x7f71d80dbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f71dffff640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71d8006660 0x7f71d80dbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f71dffff640 1 -- 172.21.15.77:0/2631944826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d803b1e0 con 0x7f71d80d1ee0 2024-04-25T13:41:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f77c1449640 1 -- 172.21.15.77:0/1482048954 wait complete. 2024-04-25T13:41:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f77c1449640 1 Processor -- start 2024-04-25T13:41:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f2943fff640 1 Processor -- start 2024-04-25T13:41:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f73af59e640 1 -- start start 2024-04-25T13:41:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73af59e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f73a8007390 0x7f73a80d98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73af59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a803a0a0 0x7f73a817ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73af59e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73a80dac70 0x7f73a817ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.279+0000 7f1a9a8a6640 1 -- 172.21.15.77:0/3839017884 wait complete. 2024-04-25T13:41:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a8a6640 1 Processor -- start 2024-04-25T13:41:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f3832d8f640 1 -- 172.21.15.77:0/3160100005 shutdown_connections 2024-04-25T13:41:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f3832d8f640 1 -- 172.21.15.77:0/3160100005 wait complete. 2024-04-25T13:41:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f3832d8f640 1 Processor -- start 2024-04-25T13:41:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f3832d8f640 1 -- start start 2024-04-25T13:41:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f8064a36640 1 -- start start 2024-04-25T13:41:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f8064a36640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8058028410 0x7f80580cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f8064a36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8058048330 0x7f80580d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f8064a36640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80580d7560 0x7f80580d3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f8064a36640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8058007cd0 con 0x7f8058048330 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f8064a36640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8058007b50 con 0x7f80580d7560 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f8064a36640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f8058007e50 con 0x7f8058028410 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8058048330 0x7f80580d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8058048330 0x7f80580d2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42202/0 (socket says 172.21.15.77:42202) 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805effd640 1 -- 172.21.15.77:0/906636842 learned_addr learned my addr 172.21.15.77:0/906636842 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805f7fe640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8058028410 0x7f80580cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805ffff640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80580d7560 0x7f80580d3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805effd640 1 -- 172.21.15.77:0/906636842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8058028410 msgr2=0x7f80580cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805effd640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8058028410 0x7f80580cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805effd640 1 -- 172.21.15.77:0/906636842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80580d7560 msgr2=0x7f80580d3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805effd640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80580d7560 0x7f80580d3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f805effd640 1 -- 172.21.15.77:0/906636842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8058177bf0 con 0x7f8058048330 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a8a6640 1 -- start start 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a8a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 0x7f1a940b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a8a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a941525f0 0x7f1a94152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a8a6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a941f7fa0 0x7f1a941f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a8a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941559c0 con 0x7f1a80005170 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a8a6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9415a360 con 0x7f1a941525f0 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a8a6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f1a94155b40 con 0x7f1a941f7fa0 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a990a3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a941525f0 0x7f1a94152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a998a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 0x7f1a940b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a998a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 0x7f1a940b85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42218/0 (socket says 172.21.15.77:42218) 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a998a4640 1 -- 172.21.15.77:0/3427945422 learned_addr learned my addr 172.21.15.77:0/3427945422 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a0a5640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a941f7fa0 0x7f1a941f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a998a4640 1 -- 172.21.15.77:0/3427945422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a941f7fa0 msgr2=0x7f1a941f83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a998a4640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a941f7fa0 0x7f1a941f83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a998a4640 1 -- 172.21.15.77:0/3427945422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a941525f0 msgr2=0x7f1a94152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a998a4640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a941525f0 0x7f1a94152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a998a4640 1 -- 172.21.15.77:0/3427945422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a941f7af0 con 0x7f1a80005170 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a998a4640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 0x7f1a940b85b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a84001bd0 tx=0x7f1a8400ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a8a7fc640 1 -- 172.21.15.77:0/3427945422 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840052e0 con 0x7f1a80005170 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7fdabd751640 1 -- 172.21.15.77:0/3803459520 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab814d600 msgr2=0x7fdab814da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7fdabd751640 1 --2- 172.21.15.77:0/3803459520 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab814d600 0x7fdab814da10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009e80 tx=0x7fdab001c870 comp rx=0 tx=0).stop 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7fdabd751640 1 -- 172.21.15.77:0/3803459520 shutdown_connections 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7fdabd751640 1 --2- 172.21.15.77:0/3803459520 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab814d600 0x7fdab814da10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7fdabd751640 1 -- 172.21.15.77:0/3803459520 >> 172.21.15.77:0/3803459520 conn(0x7fdab80c00d0 msgr2=0x7fdab80c04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7fdabd751640 1 -- 172.21.15.77:0/3803459520 shutdown_connections 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7fdabd751640 1 -- 172.21.15.77:0/3803459520 wait complete. 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73ae59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f73a8007390 0x7f73a80d98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73ae59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f73a8007390 0x7f73a80d98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:33404/0 (socket says 172.21.15.77:33404) 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73add9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a803a0a0 0x7f73a817ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73add9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a803a0a0 0x7f73a817ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42188/0 (socket says 172.21.15.77:42188) 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73af59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73a8046e20 con 0x7f73a803a0a0 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73af59e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f73a8042b10 con 0x7f73a80dac70 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73af59e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f73a80e8a60 con 0x7f73a8007390 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73ae59c640 1 -- 172.21.15.77:0/303529468 learned_addr learned my addr 172.21.15.77:0/303529468 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73aed9d640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73a80dac70 0x7f73a817ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73add9b640 1 -- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f73a8007390 msgr2=0x7f73a80d98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73add9b640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f73a8007390 0x7f73a80d98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73add9b640 1 -- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73a80dac70 msgr2=0x7f73a817ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73add9b640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73a80dac70 0x7f73a817ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73add9b640 1 -- 172.21.15.77:0/303529468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a803cd30 con 0x7f73a803a0a0 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73aed9d640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73a80dac70 0x7f73a817ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73add9b640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a803a0a0 0x7f73a817ea00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f73b00520f0 tx=0x7f73b0097500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f739effd640 1 -- 172.21.15.77:0/303529468 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b01217f0 con 0x7f73a803a0a0 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f739effd640 1 -- 172.21.15.77:0/303529468 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b0129d80 con 0x7f73a803a0a0 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f739effd640 1 -- 172.21.15.77:0/303529468 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0131430 con 0x7f73a803a0a0 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a803d010 con 0x7f73a803a0a0 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a803ac40 con 0x7f73a803a0a0 2024-04-25T13:41:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73a80d9e20 con 0x7f73a803a0a0 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f71dffff640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80d1ee0 0x7f71d803bff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f71e00515a0 tx=0x7f71e0097fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f71c7fff640 1 -- 172.21.15.77:0/2631944826 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0130030 con 0x7f71d80d1ee0 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f71c7fff640 1 -- 172.21.15.77:0/2631944826 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e0132050 con 0x7f71d80d1ee0 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f71c7fff640 1 -- 172.21.15.77:0/2631944826 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e012a7d0 con 0x7f71d80d1ee0 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d803b4c0 con 0x7f71d80d1ee0 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d803d540 con 0x7f71d80d1ee0 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2943fff640 1 -- start start 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2943fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f294406d6c0 0x7f29441488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2943fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29441516b0 0x7f29441f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2943fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2944152000 0x7f29441f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2943fff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f294415f650 con 0x7f2944152000 2024-04-25T13:41:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2943fff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f294415f4d0 con 0x7f294406d6c0 2024-04-25T13:41:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2943fff640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f294415f7d0 con 0x7f29441516b0 2024-04-25T13:41:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f1a9a8a6640 1 -- 172.21.15.77:0/3427945422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a940735b0 con 0x7f1a80005170 2024-04-25T13:41:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f1a9a8a6640 1 -- 172.21.15.77:0/3427945422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a94073110 con 0x7f1a80005170 2024-04-25T13:41:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2942ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f294406d6c0 0x7f29441488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2942ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f294406d6c0 0x7f29441488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:55518/0 (socket says 172.21.15.77:55518) 2024-04-25T13:41:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f2942ffd640 1 -- 172.21.15.77:0/2142870324 learned_addr learned my addr 172.21.15.77:0/2142870324 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f29437fe640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2944152000 0x7f29441f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f29427fc640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29441516b0 0x7f29441f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f29437fe640 1 -- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29441516b0 msgr2=0x7f29441f7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f29437fe640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29441516b0 0x7f29441f7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f29437fe640 1 -- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f294406d6c0 msgr2=0x7f29441488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f29437fe640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f294406d6c0 0x7f29441488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f1a8a7fc640 1 -- 172.21.15.77:0/3427945422 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a84018070 con 0x7f1a80005170 2024-04-25T13:41:10.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.283+0000 7f77c1449640 1 -- start start 2024-04-25T13:41:10.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77c1449640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f77bc0c0360 0x7f77bc14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f29437fe640 1 -- 172.21.15.77:0/2142870324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29440a7690 con 0x7f2944152000 2024-04-25T13:41:10.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f29427fc640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f29441516b0 0x7f29441f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:10.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77c1449640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc155a60 0x7f77bc0c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77c1449640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77bc156580 0x7f77bc149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bbfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f77bc0c0360 0x7f77bc14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bbfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f77bc0c0360 0x7f77bc14feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:33442/0 (socket says 172.21.15.77:33442) 2024-04-25T13:41:10.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f3832d8f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c06f370 0x7f382c140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f3832d8f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0a66d0 0x7f382c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7fdabd751640 1 Processor -- start 2024-04-25T13:41:10.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f71c7fff640 1 -- 172.21.15.77:0/2631944826 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f71e013d060 con 0x7f71d80d1ee0 2024-04-25T13:41:10.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f71c7fff640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f71cc06f430 0x7f71cc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f71c7fff640 1 -- 172.21.15.77:0/2631944826 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f71e01a5040 con 0x7f71d80d1ee0 2024-04-25T13:41:10.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f3832d8f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c149b20 0x7f382c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f1a8a7fc640 1 -- 172.21.15.77:0/3427945422 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840054a0 con 0x7f1a80005170 2024-04-25T13:41:10.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f29437fe640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2944152000 0x7f29441f8440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f293800e7c0 tx=0x7f293800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f805effd640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8058048330 0x7f80580d2f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c430 tx=0x7f804c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f3831d8d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c06f370 0x7f382c140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f3831d8d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c06f370 0x7f382c140600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:33450/0 (socket says 172.21.15.77:33450) 2024-04-25T13:41:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f71df7fe640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f71cc06f430 0x7f71cc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f383158c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0a66d0 0x7f382c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f383158c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0a66d0 0x7f382c15de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:55548/0 (socket says 172.21.15.77:55548) 2024-04-25T13:41:10.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f383258e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c149b20 0x7f382c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f383258e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c149b20 0x7f382c15e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42250/0 (socket says 172.21.15.77:42250) 2024-04-25T13:41:10.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc155a60 0x7f77bc0c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc155a60 0x7f77bc0c22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:55534/0 (socket says 172.21.15.77:55534) 2024-04-25T13:41:10.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bb7fe640 1 -- 172.21.15.77:0/3005205427 learned_addr learned my addr 172.21.15.77:0/3005205427 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77c1449640 1 -- 172.21.15.77:0/3005205427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc164f90 con 0x7f77bc156580 2024-04-25T13:41:10.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77c1449640 1 -- 172.21.15.77:0/3005205427 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc164e10 con 0x7f77bc155a60 2024-04-25T13:41:10.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f3831d8d640 1 -- 172.21.15.77:0/2485312584 learned_addr learned my addr 172.21.15.77:0/2485312584 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77c1449640 1 -- 172.21.15.77:0/3005205427 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f77bc165110 con 0x7f77bc0c0360 2024-04-25T13:41:10.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77c0c48640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77bc156580 0x7f77bc149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f292b7fe640 1 -- 172.21.15.77:0/2142870324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938017070 con 0x7f2944152000 2024-04-25T13:41:10.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f292b7fe640 1 -- 172.21.15.77:0/2142870324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293800c730 con 0x7f2944152000 2024-04-25T13:41:10.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f292b7fe640 1 -- 172.21.15.77:0/2142870324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293800cb00 con 0x7f2944152000 2024-04-25T13:41:10.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f382c15c7d0 con 0x7f382c149b20 2024-04-25T13:41:10.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f382c073690 con 0x7f382c0a66d0 2024-04-25T13:41:10.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f382c15c950 con 0x7f382c06f370 2024-04-25T13:41:10.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29441fbaa0 con 0x7f2944152000 2024-04-25T13:41:10.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29441fbd40 con 0x7f2944152000 2024-04-25T13:41:10.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f71df7fe640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f71cc06f430 0x7f71cc071940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009ac0 tx=0x7f71d0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f1a9a8a6640 1 -- 172.21.15.77:0/3427945422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a7c001040 con 0x7f1a80005170 2024-04-25T13:41:10.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f739effd640 1 -- 172.21.15.77:0/303529468 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f73b0138030 con 0x7f73a803a0a0 2024-04-25T13:41:10.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f739effd640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f739006f480 0x7f7390071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f739effd640 1 -- 172.21.15.77:0/303529468 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f73b01a5c00 con 0x7f73a803a0a0 2024-04-25T13:41:10.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f739effd640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f7390077750 0x7f7390079ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f739effd640 1 -- 172.21.15.77:0/303529468 --> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f739007a270 con 0x7f7390077750 2024-04-25T13:41:10.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f739effd640 1 -- 172.21.15.77:0/303529468 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f73b01a5fb0 con 0x7f73a803a0a0 2024-04-25T13:41:10.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f294406a1a0 con 0x7f2944152000 2024-04-25T13:41:10.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f71e4f63640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f71d80dc130 0x7f71d8174160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f383158c640 1 -- 172.21.15.77:0/2485312584 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c06f370 msgr2=0x7f382c140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f383158c640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c06f370 0x7f382c140600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f383158c640 1 -- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c149b20 msgr2=0x7f382c15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f383158c640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c149b20 0x7f382c15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f383158c640 1 -- 172.21.15.77:0/2485312584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c153950 con 0x7f382c0a66d0 2024-04-25T13:41:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f383258e640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c149b20 0x7f382c15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f3831d8d640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f382c06f370 0x7f382c140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f804bfff640 1 -- 172.21.15.77:0/906636842 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c017070 con 0x7f8058048330 2024-04-25T13:41:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7fdabd751640 1 -- start start 2024-04-25T13:41:10.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdabd751640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdab8072d90 0x7fdab814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdabd751640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab80a8be0 0x7fdab8148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdabd751640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdab814d600 0x7fdab814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f73ae59c640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f739006f480 0x7f7390071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 --> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71d81746a0 con 0x7f71d80dc130 2024-04-25T13:41:10.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bbfff640 1 -- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc155a60 msgr2=0x7f77bc0c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bbfff640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc155a60 0x7f77bc0c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bbfff640 1 -- 172.21.15.77:0/3005205427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77bc156580 msgr2=0x7f77bc149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bbfff640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77bc156580 0x7f77bc149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bbfff640 1 -- 172.21.15.77:0/3005205427 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc151050 con 0x7f77bc0c0360 2024-04-25T13:41:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.287+0000 7f77bbfff640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f77bc0c0360 0x7f77bc14feb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000f70 tx=0x7f77ac00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab67fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab80a8be0 0x7fdab8148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f71deffd640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f71d80dc130 0x7f71d8174160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab67fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab80a8be0 0x7fdab8148380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:33456/0 (socket says 172.21.15.77:33456) 2024-04-25T13:41:10.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f383158c640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0a66d0 0x7f382c15de00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f382c0a7210 tx=0x7f382800cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdab8072d90 0x7fdab814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdab8072d90 0x7fdab814cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42266/0 (socket says 172.21.15.77:42266) 2024-04-25T13:41:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f38227fc640 1 -- 172.21.15.77:0/2485312584 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828018070 con 0x7f382c0a66d0 2024-04-25T13:41:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a8a7fc640 1 -- 172.21.15.77:0/3427945422 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1a8400d950 con 0x7f1a80005170 2024-04-25T13:41:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a8a7fc640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1a7806f4d0 0x7f1a780719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a8a7fc640 1 -- 172.21.15.77:0/3427945422 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1a8408f360 con 0x7f1a80005170 2024-04-25T13:41:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a8a7fc640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7f1a780777a0 0x7f1a78079bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a8a7fc640 1 -- 172.21.15.77:0/3427945422 --> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a84018e70 con 0x7f1a780777a0 2024-04-25T13:41:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a8a7fc640 1 -- 172.21.15.77:0/3427945422 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1a84096050 con 0x7f1a80005170 2024-04-25T13:41:10.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdab814d600 0x7fdab814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdab814d600 0x7fdab814a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:55556/0 (socket says 172.21.15.77:55556) 2024-04-25T13:41:10.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f804bfff640 1 -- 172.21.15.77:0/906636842 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c005cf0 con 0x7f8058048330 2024-04-25T13:41:10.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8058177ed0 con 0x7f8058048330 2024-04-25T13:41:10.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80580cf4f0 con 0x7f8058048330 2024-04-25T13:41:10.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382c13b3a0 con 0x7f382c0a66d0 2024-04-25T13:41:10.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f73aed9d640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f7390077750 0x7f7390079ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c140b40 con 0x7f382c0a66d0 2024-04-25T13:41:10.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a9a0a5640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7f1a780777a0 0x7f1a78079bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a990a3640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1a7806f4d0 0x7f1a780719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f71deffd640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f71d80dc130 0x7f71d8174160 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdabd751640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdab815e750 con 0x7fdab8072d90 2024-04-25T13:41:10.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f804bfff640 1 -- 172.21.15.77:0/906636842 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c0072d0 con 0x7f8058048330 2024-04-25T13:41:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdabd751640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdab814ef10 con 0x7fdab814d600 2024-04-25T13:41:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdabd751640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fdab815e8d0 con 0x7fdab80a8be0 2024-04-25T13:41:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab67fc640 1 -- 172.21.15.77:0/2143408933 learned_addr learned my addr 172.21.15.77:0/2143408933 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8058003ee0 con 0x7f8058048330 2024-04-25T13:41:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f38227fc640 1 -- 172.21.15.77:0/2485312584 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38280072d0 con 0x7f382c0a66d0 2024-04-25T13:41:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f38227fc640 1 -- 172.21.15.77:0/2485312584 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38280047f0 con 0x7f382c0a66d0 2024-04-25T13:41:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3814001040 con 0x7f382c0a66d0 2024-04-25T13:41:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f73ae59c640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f739006f480 0x7f7390071990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73a0007fd0 tx=0x7f73a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a9a0a5640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7f1a780777a0 0x7f1a78079bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f73aed9d640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f7390077750 0x7f7390079ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f1a990a3640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1a7806f4d0 0x7f1a780719e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a940741a0 tx=0x7f1a90009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f292b7fe640 1 -- 172.21.15.77:0/2142870324 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f293801a070 con 0x7f2944152000 2024-04-25T13:41:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab67fc640 1 -- 172.21.15.77:0/2143408933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdab814d600 msgr2=0x7fdab814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab67fc640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdab814d600 0x7fdab814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab67fc640 1 -- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdab8072d90 msgr2=0x7fdab814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab67fc640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdab8072d90 0x7fdab814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab67fc640 1 -- 172.21.15.77:0/2143408933 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab814bd60 con 0x7fdab80a8be0 2024-04-25T13:41:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdab67fc640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab80a8be0 0x7fdab8148380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800c3f0 tx=0x7fdaa800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f292b7fe640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f293006f500 0x7f2930071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f292b7fe640 1 -- 172.21.15.77:0/2142870324 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f293808f770 con 0x7f2944152000 2024-04-25T13:41:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fda9f7fe640 1 -- 172.21.15.77:0/2143408933 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8017070 con 0x7fdab80a8be0 2024-04-25T13:41:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab814c040 con 0x7fdab80a8be0 2024-04-25T13:41:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f292b7fe640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7f29300777d0 0x7f2930079c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f292b7fe640 1 -- 172.21.15.77:0/2142870324 --> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29380044c0 con 0x7f29300777d0 2024-04-25T13:41:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f292b7fe640 1 -- 172.21.15.77:0/2142870324 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f293808fb60 con 0x7f2944152000 2024-04-25T13:41:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab8148a90 con 0x7fdab80a8be0 2024-04-25T13:41:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fda9f7fe640 1 -- 172.21.15.77:0/2143408933 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa80052d0 con 0x7fdab80a8be0 2024-04-25T13:41:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7fda9f7fe640 1 -- 172.21.15.77:0/2143408933 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8003800 con 0x7fdab80a8be0 2024-04-25T13:41:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f77b8ff9640 1 -- 172.21.15.77:0/3005205427 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac017070 con 0x7f77bc0c0360 2024-04-25T13:41:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f29427fc640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7f29300777d0 0x7f2930079c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f2942ffd640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f293006f500 0x7f2930071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f804bfff640 1 -- 172.21.15.77:0/906636842 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f804c01a070 con 0x7f8058048330 2024-04-25T13:41:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f77c1449640 1 -- 172.21.15.77:0/3005205427 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77bc1f3690 con 0x7f77bc0c0360 2024-04-25T13:41:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.291+0000 7f77c1449640 1 -- 172.21.15.77:0/3005205427 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77bc14d260 con 0x7f77bc0c0360 2024-04-25T13:41:10.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdab806a1a0 con 0x7fdab80a8be0 2024-04-25T13:41:10.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f77b8ff9640 1 -- 172.21.15.77:0/3005205427 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac0052d0 con 0x7f77bc0c0360 2024-04-25T13:41:10.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f77c1449640 1 -- 172.21.15.77:0/3005205427 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77bc06a1a0 con 0x7f77bc0c0360 2024-04-25T13:41:10.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f77b8ff9640 1 -- 172.21.15.77:0/3005205427 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac003840 con 0x7f77bc0c0360 2024-04-25T13:41:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f739effd640 1 -- 172.21.15.77:0/303529468 <== osd.4 v2:172.21.15.96:6824/779501835 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f739007a270 con 0x7f7390077750 2024-04-25T13:41:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f804bfff640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f804406f430 0x7f8044071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f1a8a7fc640 1 -- 172.21.15.77:0/3427945422 <== osd.2 v2:172.21.15.77:6800/4192345588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a8c0baa50 con 0x7f1a780777a0 2024-04-25T13:41:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f804bfff640 1 -- 172.21.15.77:0/906636842 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f804c08ee20 con 0x7f8058048330 2024-04-25T13:41:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f805f7fe640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f804406f430 0x7f8044071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f804bfff640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f8044077700 0x7f8044079b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f29427fc640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7f29300777d0 0x7f2930079c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f2942ffd640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f293006f500 0x7f2930071a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2934000f70 tx=0x7f2934007ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f804bfff640 1 -- 172.21.15.77:0/906636842 --> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f804c005cf0 con 0x7f8044077700 2024-04-25T13:41:10.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f805ffff640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f8044077700 0x7f8044079b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f804bfff640 1 -- 172.21.15.77:0/906636842 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f804c08f210 con 0x7f8058048330 2024-04-25T13:41:10.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f805ffff640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f8044077700 0x7f8044079b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f71c7fff640 1 -- 172.21.15.77:0/2631944826 <== osd.5 v2:172.21.15.96:6800/3584918430 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71d81746a0 con 0x7f71d80dc130 2024-04-25T13:41:10.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f805f7fe640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f804406f430 0x7f8044071940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80540ad000 tx=0x7f80540a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f38227fc640 1 -- 172.21.15.77:0/2485312584 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f382801b070 con 0x7f382c0a66d0 2024-04-25T13:41:10.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f38227fc640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f381006f430 0x7f3810071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f38227fc640 1 -- 172.21.15.77:0/2485312584 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f382808e980 con 0x7f382c0a66d0 2024-04-25T13:41:10.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f38227fc640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7f3810077700 0x7f3810079b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f804bfff640 1 -- 172.21.15.77:0/906636842 <== osd.1 v2:172.21.15.77:6809/2369138658 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f804c005cf0 con 0x7f8044077700 2024-04-25T13:41:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f383258e640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7f3810077700 0x7f3810079b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f383258e640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7f3810077700 0x7f3810079b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f38227fc640 1 -- 172.21.15.77:0/2485312584 --> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f382801ee50 con 0x7f3810077700 2024-04-25T13:41:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f38227fc640 1 -- 172.21.15.77:0/2485312584 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f382808ed70 con 0x7f382c0a66d0 2024-04-25T13:41:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f38227fc640 1 -- 172.21.15.77:0/2485312584 <== osd.0 v2:172.21.15.77:6824/1056805701 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f382801ee50 con 0x7f3810077700 2024-04-25T13:41:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f3831d8d640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f381006f430 0x7f3810071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f3831d8d640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f381006f430 0x7f3810071940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f382401c710 tx=0x7f38240b4040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77b8ff9640 1 -- 172.21.15.77:0/3005205427 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f77ac01a070 con 0x7f77bc0c0360 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77b8ff9640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f77a806f500 0x7f77a8071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77bb7fe640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f77a806f500 0x7f77a8071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77b8ff9640 1 -- 172.21.15.77:0/3005205427 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f77ac08ec90 con 0x7f77bc0c0360 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77b8ff9640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f77a80777d0 0x7f77a8079c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77b8ff9640 1 -- 172.21.15.77:0/3005205427 --> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77ac009e50 con 0x7f77a80777d0 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77b8ff9640 1 -- 172.21.15.77:0/3005205427 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f77ac08f080 con 0x7f77bc0c0360 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77bb7fe640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f77a806f500 0x7f77a8071a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77b00011f0 tx=0x7f77b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77c0c48640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f77a80777d0 0x7f77a8079c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7f77c0c48640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f77a80777d0 0x7f77a8079c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.295+0000 7f292b7fe640 1 -- 172.21.15.77:0/2142870324 <== osd.7 v2:172.21.15.96:6811/1677667216 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29380044c0 con 0x7f29300777d0 2024-04-25T13:41:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7fda9f7fe640 1 -- 172.21.15.77:0/2143408933 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdaa801a070 con 0x7fdab80a8be0 2024-04-25T13:41:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.299+0000 7fda9f7fe640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fdaa406f430 0x7fdaa4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7fda9f7fe640 1 -- 172.21.15.77:0/2143408933 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdaa808ede0 con 0x7fdab80a8be0 2024-04-25T13:41:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7fdab6ffd640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fdaa406f430 0x7fdaa4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7fda9f7fe640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fdaa4077620 0x7fdaa4079a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7fda9f7fe640 1 -- 172.21.15.77:0/2143408933 --> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdaa8009e50 con 0x7fdaa4077620 2024-04-25T13:41:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7fda9f7fe640 1 -- 172.21.15.77:0/2143408933 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdaa808f1d0 con 0x7fdab80a8be0 2024-04-25T13:41:10.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7f77b8ff9640 1 -- 172.21.15.77:0/3005205427 <== osd.6 v2:172.21.15.96:6808/4031837167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77ac009e50 con 0x7f77a80777d0 2024-04-25T13:41:10.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7fdab77fe640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fdaa4077620 0x7fdaa4079a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7fdab77fe640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fdaa4077620 0x7fdaa4079a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7fdab6ffd640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fdaa406f430 0x7fdaa4071940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdab80702a0 tx=0x7fdaac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.303+0000 7fda9f7fe640 1 -- 172.21.15.77:0/2143408933 <== osd.3 v2:172.21.15.77:6808/3215381613 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdaa8009e50 con 0x7fdaa4077620 2024-04-25T13:41:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.319+0000 7f1a9a8a6640 1 -- 172.21.15.77:0/3427945422 --> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a7c002de0 con 0x7f1a780777a0 2024-04-25T13:41:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a8a7fc640 1 -- 172.21.15.77:0/3427945422 <== osd.2 v2:172.21.15.77:6800/4192345588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1a7c002de0 con 0x7f1a780777a0 2024-04-25T13:41:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 -- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7f1a780777a0 msgr2=0x7f1a78079bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7f1a780777a0 0x7f1a78079bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 -- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1a7806f4d0 msgr2=0x7f1a780719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1a7806f4d0 0x7f1a780719e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a940741a0 tx=0x7f1a90009190 comp rx=0 tx=0).stop 2024-04-25T13:41:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 -- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 msgr2=0x7f1a940b85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 --2- 172.21.15.77:0/3427945422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a80005170 0x7f1a940b85b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a84001bd0 tx=0x7f1a8400ff00 comp rx=0 tx=0).stop 2024-04-25T13:41:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a9a0a5640 1 -- 172.21.15.77:0/3427945422 reap_dead start 2024-04-25T13:41:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 --> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f73a80054b0 con 0x7f7390077750 2024-04-25T13:41:10.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 -- 172.21.15.77:0/3427945422 shutdown_connections 2024-04-25T13:41:10.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 -- 172.21.15.77:0/3427945422 >> 172.21.15.77:0/3427945422 conn(0x7f1a940c3590 msgr2=0x7f1a9406e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 -- 172.21.15.77:0/3427945422 shutdown_connections 2024-04-25T13:41:10.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f1a77fff640 1 -- 172.21.15.77:0/3427945422 wait complete. 2024-04-25T13:41:10.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 --> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29440a7300 con 0x7f29300777d0 2024-04-25T13:41:10.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f739effd640 1 -- 172.21.15.77:0/303529468 <== osd.4 v2:172.21.15.96:6824/779501835 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f73a80054b0 con 0x7f7390077750 2024-04-25T13:41:10.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f7390077750 msgr2=0x7f7390079ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f292b7fe640 1 -- 172.21.15.77:0/2142870324 <== osd.7 v2:172.21.15.96:6811/1677667216 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f29440a7300 con 0x7f29300777d0 2024-04-25T13:41:10.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f73af59e640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f7390077750 0x7f7390079ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f739006f480 msgr2=0x7f7390071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f73af59e640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f739006f480 0x7f7390071990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73a0007fd0 tx=0x7f73a0009040 comp rx=0 tx=0).stop 2024-04-25T13:41:10.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a803a0a0 msgr2=0x7f73a817ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 --> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8058004340 con 0x7f8044077700 2024-04-25T13:41:10.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f73af59e640 1 --2- 172.21.15.77:0/303529468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73a803a0a0 0x7f73a817ea00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f73b00520f0 tx=0x7f73b0097500 comp rx=0 tx=0).stop 2024-04-25T13:41:10.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f73aed9d640 1 -- 172.21.15.77:0/303529468 reap_dead start 2024-04-25T13:41:10.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f804bfff640 1 -- 172.21.15.77:0/906636842 <== osd.1 v2:172.21.15.77:6809/2369138658 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8058004340 con 0x7f8044077700 2024-04-25T13:41:10.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7f29300777d0 msgr2=0x7f2930079c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.323+0000 7f2943fff640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7f29300777d0 0x7f2930079c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f293006f500 msgr2=0x7f2930071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 shutdown_connections 2024-04-25T13:41:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f2943fff640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f293006f500 0x7f2930071a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2934000f70 tx=0x7f2934007ee0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2944152000 msgr2=0x7f29441f8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f2943fff640 1 --2- 172.21.15.77:0/2142870324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2944152000 0x7f29441f8440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f293800e7c0 tx=0x7f293800ec80 comp rx=0 tx=0).stop 2024-04-25T13:41:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f29437fe640 1 -- 172.21.15.77:0/2142870324 reap_dead start 2024-04-25T13:41:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 shutdown_connections 2024-04-25T13:41:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 >> 172.21.15.77:0/2142870324 conn(0x7f29440c56f0 msgr2=0x7f29440a4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 >> 172.21.15.77:0/303529468 conn(0x7f73a800a640 msgr2=0x7f73a8026f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f8044077700 msgr2=0x7f8044079b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f8044077700 0x7f8044079b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 shutdown_connections 2024-04-25T13:41:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f804406f430 msgr2=0x7f8044071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f804406f430 0x7f8044071940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80540ad000 tx=0x7f80540a6000 comp rx=0 tx=0).stop 2024-04-25T13:41:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8058048330 msgr2=0x7f80580d2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 --2- 172.21.15.77:0/906636842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8058048330 0x7f80580d2f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c430 tx=0x7f804c00c8f0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f805ffff640 1 -- 172.21.15.77:0/906636842 reap_dead start 2024-04-25T13:41:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 shutdown_connections 2024-04-25T13:41:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 >> 172.21.15.77:0/906636842 conn(0x7f8058049210 msgr2=0x7f8058029660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 shutdown_connections 2024-04-25T13:41:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f2943fff640 1 -- 172.21.15.77:0/2142870324 wait complete. 2024-04-25T13:41:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f73af59e640 1 -- 172.21.15.77:0/303529468 wait complete. 2024-04-25T13:41:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 shutdown_connections 2024-04-25T13:41:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.327+0000 7f8064a36640 1 -- 172.21.15.77:0/906636842 wait complete. 2024-04-25T13:41:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 --> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3814002de0 con 0x7f3810077700 2024-04-25T13:41:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 --> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f71d80dc750 con 0x7f71d80dc130 2024-04-25T13:41:10.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f38227fc640 1 -- 172.21.15.77:0/2485312584 <== osd.0 v2:172.21.15.77:6824/1056805701 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3814002de0 con 0x7f3810077700 2024-04-25T13:41:10.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f77c1449640 1 -- 172.21.15.77:0/3005205427 --> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77bc0a9fa0 con 0x7f77a80777d0 2024-04-25T13:41:10.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7f3810077700 msgr2=0x7f3810079b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f3832d8f640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7f3810077700 0x7f3810079b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f71c7fff640 1 -- 172.21.15.77:0/2631944826 <== osd.5 v2:172.21.15.96:6800/3584918430 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f71d40013d0 con 0x7f71d80dc130 2024-04-25T13:41:10.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f77b8ff9640 1 -- 172.21.15.77:0/3005205427 <== osd.6 v2:172.21.15.96:6808/4031837167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f77bc0a9fa0 con 0x7f77a80777d0 2024-04-25T13:41:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f381006f430 msgr2=0x7f3810071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f3832d8f640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f381006f430 0x7f3810071940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f382401c710 tx=0x7f38240b4040 comp rx=0 tx=0).stop 2024-04-25T13:41:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0a66d0 msgr2=0x7f382c15de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f3832d8f640 1 --2- 172.21.15.77:0/2485312584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f382c0a66d0 0x7f382c15de00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f382c0a7210 tx=0x7f382800cbe0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7f383258e640 1 -- 172.21.15.77:0/2485312584 reap_dead start 2024-04-25T13:41:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.331+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 --> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdab80a6160 con 0x7fdaa4077620 2024-04-25T13:41:10.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 shutdown_connections 2024-04-25T13:41:10.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 >> 172.21.15.77:0/2485312584 conn(0x7f382c0c33c0 msgr2=0x7f382c0c2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f71d80dc130 msgr2=0x7f71d8174160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 shutdown_connections 2024-04-25T13:41:10.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f3832d8f640 1 -- 172.21.15.77:0/2485312584 wait complete. 2024-04-25T13:41:10.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f71e4f63640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f71d80dc130 0x7f71d8174160 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fda9f7fe640 1 -- 172.21.15.77:0/2143408933 <== osd.3 v2:172.21.15.77:6808/3215381613 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdab80a6160 con 0x7fdaa4077620 2024-04-25T13:41:10.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f71cc06f430 msgr2=0x7f71cc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f71e4f63640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f71cc06f430 0x7f71cc071940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009ac0 tx=0x7f71d0009190 comp rx=0 tx=0).stop 2024-04-25T13:41:10.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80d1ee0 msgr2=0x7f71d803bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f71e4f63640 1 --2- 172.21.15.77:0/2631944826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80d1ee0 0x7f71d803bff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f71e00515a0 tx=0x7f71e0097fb0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f71dffff640 1 -- 172.21.15.77:0/2631944826 reap_dead start 2024-04-25T13:41:10.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 shutdown_connections 2024-04-25T13:41:10.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 >> 172.21.15.77:0/2631944826 conn(0x7f71d8028f70 msgr2=0x7f71d80d55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fdaa4077620 msgr2=0x7fdaa4079a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fdabd751640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fdaa4077620 0x7fdaa4079a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fdaa406f430 msgr2=0x7fdaa4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fdabd751640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fdaa406f430 0x7fdaa4071940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdab80702a0 tx=0x7fdaac009040 comp rx=0 tx=0).stop 2024-04-25T13:41:10.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab80a8be0 msgr2=0x7fdab8148380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fdabd751640 1 --2- 172.21.15.77:0/2143408933 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdab80a8be0 0x7fdab8148380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800c3f0 tx=0x7fdaa800c8b0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fdab77fe640 1 -- 172.21.15.77:0/2143408933 reap_dead start 2024-04-25T13:41:10.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 shutdown_connections 2024-04-25T13:41:10.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.335+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 >> 172.21.15.77:0/2143408933 conn(0x7fdab80c00d0 msgr2=0x7fdab8071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 shutdown_connections 2024-04-25T13:41:10.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f71e4f63640 1 -- 172.21.15.77:0/2631944826 wait complete. 2024-04-25T13:41:10.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 -- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f77a80777d0 msgr2=0x7f77a8079c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f77a80777d0 0x7f77a8079c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 -- 172.21.15.77:0/3005205427 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f77a806f500 msgr2=0x7f77a8071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f77a806f500 0x7f77a8071a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77b00011f0 tx=0x7f77b0009040 comp rx=0 tx=0).stop 2024-04-25T13:41:10.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 -- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f77bc0c0360 msgr2=0x7f77bc14feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 --2- 172.21.15.77:0/3005205427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f77bc0c0360 0x7f77bc14feb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000f70 tx=0x7f77ac00c820 comp rx=0 tx=0).stop 2024-04-25T13:41:10.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77c0c48640 1 -- 172.21.15.77:0/3005205427 reap_dead start 2024-04-25T13:41:10.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 -- 172.21.15.77:0/3005205427 shutdown_connections 2024-04-25T13:41:10.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 -- 172.21.15.77:0/3005205427 >> 172.21.15.77:0/3005205427 conn(0x7f77bc06c780 msgr2=0x7f77bc0a4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 -- 172.21.15.77:0/3005205427 shutdown_connections 2024-04-25T13:41:10.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.339+0000 7f77a27fc640 1 -- 172.21.15.77:0/3005205427 wait complete. 2024-04-25T13:41:10.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.343+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 shutdown_connections 2024-04-25T13:41:10.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.343+0000 7fdabd751640 1 -- 172.21.15.77:0/2143408933 wait complete. 2024-04-25T13:41:10.371 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T13:41:10.372 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2024-04-25T13:41:10.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T13:41:10.373 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.374 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T13:41:10.374 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T13:41:10.376 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T13:41:10.378 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T13:41:10.380 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2024-04-25T13:41:10.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T13:41:10.382 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T13:41:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.571+0000 7fd2fdb27640 1 Processor -- start 2024-04-25T13:41:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.571+0000 7fd2fdb27640 1 -- start start 2024-04-25T13:41:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2fdb27640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 0x7fd2f8151770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2fdb27640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2f80c0bf0 0x7fd2f80718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2fdb27640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f814e8c0 con 0x7fd2f8071de0 2024-04-25T13:41:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2fdb27640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f814f3a0 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2fdb27640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f8074c60 con 0x7fd2f80a8be0 2024-04-25T13:41:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d8072640 1 Processor -- start 2024-04-25T13:41:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2f6ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2f80c0bf0 0x7fd2f80718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2f77fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 0x7fd2f8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2f6ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2f80c0bf0 0x7fd2f80718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:55572/0 (socket says 172.21.15.77:55572) 2024-04-25T13:41:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2f6ffd640 1 -- 172.21.15.77:0/12358694 learned_addr learned my addr 172.21.15.77:0/12358694 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d8072640 1 -- start start 2024-04-25T13:41:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2f6ffd640 1 -- 172.21.15.77:0/12358694 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 msgr2=0x7fd2f8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2f6ffd640 1 --2- 172.21.15.77:0/12358694 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 0x7fd2f8151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2f6ffd640 1 -- 172.21.15.77:0/12358694 >> v1:172.21.15.96:6789/0 conn(0x7fd2f8071de0 legacy=0x7fd2f814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fd2f6ffd640 1 -- 172.21.15.77:0/12358694 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f814eba0 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d8072640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe9d00a88c0 0x7fe9d006fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d8072640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9d0156b60 0x7fe9d0156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d8072640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d00a6240 con 0x7fe9d0155b40 2024-04-25T13:41:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d8072640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d0156660 con 0x7fe9d0156b60 2024-04-25T13:41:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d8072640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d015a6a0 con 0x7fe9d00a88c0 2024-04-25T13:41:10.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d660f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9d0156b60 0x7fe9d0156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d660f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9d0156b60 0x7fe9d0156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42280/0 (socket says 172.21.15.77:42280) 2024-04-25T13:41:10.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d5e0e640 1 --2- 172.21.15.77:0/221591458 >> v2:172.21.15.96:3300/0 conn(0x7fe9d00a88c0 0x7fe9d006fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d660f640 1 -- 172.21.15.77:0/221591458 learned_addr learned my addr 172.21.15.77:0/221591458 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d660f640 1 -- 172.21.15.77:0/221591458 >> v2:172.21.15.96:3300/0 conn(0x7fe9d00a88c0 msgr2=0x7fe9d006fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d660f640 1 --2- 172.21.15.77:0/221591458 >> v2:172.21.15.96:3300/0 conn(0x7fe9d00a88c0 0x7fe9d006fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d660f640 1 -- 172.21.15.77:0/221591458 >> v1:172.21.15.96:6789/0 conn(0x7fe9d0155b40 legacy=0x7fe9d0155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.575+0000 7fe9d660f640 1 -- 172.21.15.77:0/221591458 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d015a980 con 0x7fe9d0156b60 2024-04-25T13:41:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2f6ffd640 1 --2- 172.21.15.77:0/12358694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2f80c0bf0 0x7fd2f80718a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009e50 tx=0x7fd2f001c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eebb25b446680ab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2f67fc640 1 -- 172.21.15.77:0/12358694 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00a56e0 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2f67fc640 1 -- 172.21.15.77:0/12358694 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f00a5880 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2f67fc640 1 -- 172.21.15.77:0/12358694 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00a5c50 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2fdb27640 1 -- 172.21.15.77:0/12358694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2f80c0bf0 msgr2=0x7fd2f80718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2fdb27640 1 --2- 172.21.15.77:0/12358694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2f80c0bf0 0x7fd2f80718a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009e50 tx=0x7fd2f001c910 comp rx=0 tx=0).stop 2024-04-25T13:41:10.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2fdb27640 1 -- 172.21.15.77:0/12358694 shutdown_connections 2024-04-25T13:41:10.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2fdb27640 1 --2- 172.21.15.77:0/12358694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2f80c0bf0 0x7fd2f80718a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2fdb27640 1 --2- 172.21.15.77:0/12358694 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 0x7fd2f8151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2fdb27640 1 -- 172.21.15.77:0/12358694 >> 172.21.15.77:0/12358694 conn(0x7fd2f80c00d0 msgr2=0x7fd2f80c04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2fdb27640 1 -- 172.21.15.77:0/12358694 shutdown_connections 2024-04-25T13:41:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fe9d660f640 1 --2- 172.21.15.77:0/221591458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d0156b60 0x7fe9d0156f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0070230 tx=0x7fe9cc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13662863e2332e75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fe9d4e0c640 1 -- 172.21.15.77:0/221591458 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0b1070 con 0x7fe9d0156b60 2024-04-25T13:41:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fe9d4e0c640 1 -- 172.21.15.77:0/221591458 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0ac620 con 0x7fe9d0156b60 2024-04-25T13:41:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fe9d4e0c640 1 -- 172.21.15.77:0/221591458 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0ac9f0 con 0x7fe9d0156b60 2024-04-25T13:41:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.579+0000 7fd2fdb27640 1 -- 172.21.15.77:0/12358694 wait complete. 2024-04-25T13:41:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fe9d8072640 1 -- 172.21.15.77:0/221591458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d0156b60 msgr2=0x7fe9d0156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fe9d8072640 1 --2- 172.21.15.77:0/221591458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d0156b60 0x7fe9d0156f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0070230 tx=0x7fe9cc01c3c0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fe9d8072640 1 -- 172.21.15.77:0/221591458 shutdown_connections 2024-04-25T13:41:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fe9d8072640 1 --2- 172.21.15.77:0/221591458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d0156b60 0x7fe9d0156f70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fe9d8072640 1 --2- 172.21.15.77:0/221591458 >> v2:172.21.15.96:3300/0 conn(0x7fe9d00a88c0 0x7fe9d006fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fe9d8072640 1 -- 172.21.15.77:0/221591458 >> 172.21.15.77:0/221591458 conn(0x7fe9d00c04d0 msgr2=0x7fe9d00c08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2fdb27640 1 Processor -- start 2024-04-25T13:41:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2fdb27640 1 -- start start 2024-04-25T13:41:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fe9d8072640 1 -- 172.21.15.77:0/221591458 shutdown_connections 2024-04-25T13:41:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fe9d8072640 1 -- 172.21.15.77:0/221591458 wait complete. 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2fdb27640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2f8071de0 0x7fd2f8147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2fdb27640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 0x7fd2f8144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2fdb27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f80c0bf0 0x7fd2f813eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2fdb27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f814e0a0 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2fdb27640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f814df20 con 0x7fd2f8071de0 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2fdb27640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f814e220 con 0x7fd2f80a8be0 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f80c0bf0 0x7fd2f813eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f80c0bf0 0x7fd2f813eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42284/0 (socket says 172.21.15.77:42284) 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f7fff640 1 -- 172.21.15.77:0/2445791969 learned_addr learned my addr 172.21.15.77:0/2445791969 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f77fe640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2f8071de0 0x7fd2f8147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f6ffd640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 0x7fd2f8144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7f0afed3a640 1 Processor -- start 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f7fff640 1 -- 172.21.15.77:0/2445791969 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 msgr2=0x7fd2f8144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f7fff640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 0x7fd2f8144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f7fff640 1 -- 172.21.15.77:0/2445791969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2f8071de0 msgr2=0x7fd2f8147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f7fff640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2f8071de0 0x7fd2f8147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7fd2f7fff640 1 -- 172.21.15.77:0/2445791969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f81437f0 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2f7fff640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f80c0bf0 0x7fd2f813eb80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00c3c0 tx=0x7fd2ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2dffff640 1 -- 172.21.15.77:0/2445791969 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec0052d0 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2dffff640 1 -- 172.21.15.77:0/2445791969 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ec005470 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2dffff640 1 -- 172.21.15.77:0/2445791969 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec007260 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2fdb27640 1 -- 172.21.15.77:0/2445791969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f81475c0 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2fdb27640 1 -- 172.21.15.77:0/2445791969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f813f6d0 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fe9d8072640 1 Processor -- start 2024-04-25T13:41:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.583+0000 7f0afed3a640 1 -- start start 2024-04-25T13:41:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afed3a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0af80c3ee0 0x7f0af80a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afed3a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0af814e970 0x7f0af8158b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afed3a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af80a6d30 con 0x7f0af8152080 2024-04-25T13:41:10.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afed3a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0af80a70a0 con 0x7f0af814e970 2024-04-25T13:41:10.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afed3a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0af806f000 con 0x7f0af80c3ee0 2024-04-25T13:41:10.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afd537640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0af8152080 0x7f0af806e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58986/0 (socket says 172.21.15.77:58986) 2024-04-25T13:41:10.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afd537640 1 -- 172.21.15.77:0/3675460932 learned_addr learned my addr 172.21.15.77:0/3675460932 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:10.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2fdb27640 1 -- 172.21.15.77:0/2445791969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d80052a0 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afe539640 1 --2- 172.21.15.77:0/3675460932 >> v2:172.21.15.77:3300/0 conn(0x7f0af814e970 0x7f0af8158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afdd38640 1 --2- 172.21.15.77:0/3675460932 >> v2:172.21.15.96:3300/0 conn(0x7f0af80c3ee0 0x7f0af80a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fe9d8072640 1 -- start start 2024-04-25T13:41:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afcd36640 1 -- 172.21.15.77:0/3675460932 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093514142 0 0) 0x7f0af80a6d30 con 0x7f0af8152080 2024-04-25T13:41:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afcd36640 1 -- 172.21.15.77:0/3675460932 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae4003530 con 0x7f0af8152080 2024-04-25T13:41:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afdd38640 1 -- 172.21.15.77:0/3675460932 >> v2:172.21.15.77:3300/0 conn(0x7f0af814e970 msgr2=0x7f0af8158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afdd38640 1 --2- 172.21.15.77:0/3675460932 >> v2:172.21.15.77:3300/0 conn(0x7f0af814e970 0x7f0af8158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afdd38640 1 -- 172.21.15.77:0/3675460932 >> v1:172.21.15.77:6789/0 conn(0x7f0af8152080 legacy=0x7f0af806e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7f0afdd38640 1 -- 172.21.15.77:0/3675460932 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af80a7530 con 0x7f0af80c3ee0 2024-04-25T13:41:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2dffff640 1 -- 172.21.15.77:0/2445791969 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd2ec007400 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2dffff640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2e406f430 0x7fd2e4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.587+0000 7fd2dffff640 1 -- 172.21.15.77:0/2445791969 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd2ec08e620 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d8072640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d00a88c0 0x7fe9d0071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d8072640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9d0155b40 0x7fe9d00737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d8072640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9d0156b60 0x7fe9d0073d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d8072640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d0163aa0 con 0x7fe9d00a88c0 2024-04-25T13:41:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d8072640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d0163920 con 0x7fe9d0155b40 2024-04-25T13:41:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d8072640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d0163c20 con 0x7fe9d0156b60 2024-04-25T13:41:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fd2f77fe640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2e406f430 0x7fd2e4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d5e0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d00a88c0 0x7fe9d0071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d5e0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d00a88c0 0x7fe9d0071da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42294/0 (socket says 172.21.15.77:42294) 2024-04-25T13:41:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d5e0e640 1 -- 172.21.15.77:0/1468185915 learned_addr learned my addr 172.21.15.77:0/1468185915 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d660f640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9d0156b60 0x7fe9d0073d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fd2f77fe640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2e406f430 0x7fd2e4071940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80702a0 tx=0x7fd2e8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f6f28b5f640 1 Processor -- start 2024-04-25T13:41:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f6f28b5f640 1 -- start start 2024-04-25T13:41:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d5e0e640 1 -- 172.21.15.77:0/1468185915 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9d0156b60 msgr2=0x7fe9d0073d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d5e0e640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9d0156b60 0x7fe9d0073d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d5e0e640 1 -- 172.21.15.77:0/1468185915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9d0155b40 msgr2=0x7fe9d00737f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:41:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d5e0e640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9d0155b40 0x7fe9d00737f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d5e0e640 1 -- 172.21.15.77:0/1468185915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d01478d0 con 0x7fe9d00a88c0 2024-04-25T13:41:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7fe9d5e0e640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d00a88c0 0x7fe9d0071da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400e8a0 tx=0x7fe9c400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afdd38640 1 --2- 172.21.15.77:0/3675460932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0af80c3ee0 0x7f0af80a7b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0af80c4420 tx=0x7f0af401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52f8551f8f59154f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afcd36640 1 -- 172.21.15.77:0/3675460932 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af40b0070 con 0x7f0af80c3ee0 2024-04-25T13:41:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afcd36640 1 -- 172.21.15.77:0/3675460932 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af40ab600 con 0x7f0af80c3ee0 2024-04-25T13:41:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afcd36640 1 -- 172.21.15.77:0/3675460932 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af40ab9f0 con 0x7f0af80c3ee0 2024-04-25T13:41:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f6f28b5f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6f240a6ff0 0x7f6f240a7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f6f28b5f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240a6390 con 0x7f6f240a7b50 2024-04-25T13:41:10.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f6f28b5f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240a7f60 con 0x7f6f24151a60 2024-04-25T13:41:10.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f6f28b5f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f6f240a6880 con 0x7f6f240a6ff0 2024-04-25T13:41:10.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afed3a640 1 -- 172.21.15.77:0/3675460932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0af80c3ee0 msgr2=0x7f0af80a7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afed3a640 1 --2- 172.21.15.77:0/3675460932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0af80c3ee0 0x7f0af80a7b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0af80c4420 tx=0x7f0af401c410 comp rx=0 tx=0).stop 2024-04-25T13:41:10.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f6f2259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6f240a7b50 0x7f6f2406ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58988/0 (socket says 172.21.15.77:58988) 2024-04-25T13:41:10.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f6f2259c640 1 -- 172.21.15.77:0/2054304751 learned_addr learned my addr 172.21.15.77:0/2054304751 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:10.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afed3a640 1 -- 172.21.15.77:0/3675460932 shutdown_connections 2024-04-25T13:41:10.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afed3a640 1 --2- 172.21.15.77:0/3675460932 >> v2:172.21.15.77:3300/0 conn(0x7f0af814e970 0x7f0af8158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afed3a640 1 --2- 172.21.15.77:0/3675460932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0af80c3ee0 0x7f0af80a7b50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.591+0000 7f0afed3a640 1 -- 172.21.15.77:0/3675460932 >> 172.21.15.77:0/3675460932 conn(0x7f0af80c33c0 msgr2=0x7f0af80c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f0afed3a640 1 -- 172.21.15.77:0/3675460932 shutdown_connections 2024-04-25T13:41:10.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f0afed3a640 1 -- 172.21.15.77:0/3675460932 wait complete. 2024-04-25T13:41:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f6f21d9b640 1 --2- 172.21.15.77:0/2054304751 >> v2:172.21.15.96:3300/0 conn(0x7f6f240a6ff0 0x7f6f240a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f6f2159a640 1 -- 172.21.15.77:0/2054304751 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128852755 0 0) 0x7f6f240a7f60 con 0x7f6f24151a60 2024-04-25T13:41:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f6f2159a640 1 -- 172.21.15.77:0/2054304751 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f0c003530 con 0x7f6f24151a60 2024-04-25T13:41:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f6f2159a640 1 -- 172.21.15.77:0/2054304751 <== mon.1 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4068460412 0 0) 0x7f6f0c003530 con 0x7f6f24151a60 2024-04-25T13:41:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f6f21d9b640 1 -- 172.21.15.77:0/2054304751 >> v1:172.21.15.96:6789/0 conn(0x7f6f24151a60 legacy=0x7f6f24151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f6f21d9b640 1 -- 172.21.15.77:0/2054304751 >> v1:172.21.15.77:6789/0 conn(0x7f6f240a7b50 legacy=0x7f6f2406ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f6f21d9b640 1 -- 172.21.15.77:0/2054304751 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f240a8220 con 0x7f6f240a6ff0 2024-04-25T13:41:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f84749a9640 1 Processor -- start 2024-04-25T13:41:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7fc561d33640 1 Processor -- start 2024-04-25T13:41:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7fc561d33640 1 -- start start 2024-04-25T13:41:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f84749a9640 1 -- start start 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f0afed3a640 1 Processor -- start 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f0afed3a640 1 -- start start 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f0afed3a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0af80c3ee0 0x7f0af80a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.595+0000 7f0afed3a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af814e970 0x7f0af81f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afed3a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0af8152080 0x7f0af81f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afed3a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0af815b250 con 0x7f0af814e970 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afed3a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0af815b0d0 con 0x7f0af8152080 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afed3a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f0af815b3d0 con 0x7f0af80c3ee0 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afdd38640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0af80c3ee0 0x7f0af80a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afdd38640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0af80c3ee0 0x7f0af80a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:33496/0 (socket says 172.21.15.77:33496) 2024-04-25T13:41:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afdd38640 1 -- 172.21.15.77:0/2075517595 learned_addr learned my addr 172.21.15.77:0/2075517595 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afd537640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af814e970 0x7f0af81f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afe539640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0af8152080 0x7f0af81f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afd537640 1 -- 172.21.15.77:0/2075517595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0af80c3ee0 msgr2=0x7f0af80a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afd537640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0af80c3ee0 0x7f0af80a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afd537640 1 -- 172.21.15.77:0/2075517595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0af8152080 msgr2=0x7f0af81f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afd537640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0af8152080 0x7f0af81f2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afd537640 1 -- 172.21.15.77:0/2075517595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af814d450 con 0x7f0af814e970 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc561d33640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc55404a810 0x7fc55402a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc561d33640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc554046ee0 0x7fc554006420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc561d33640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55402acb0 con 0x7fc5540d6b90 2024-04-25T13:41:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc561d33640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc5540d5f90 con 0x7fc55404a810 2024-04-25T13:41:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc561d33640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc554046690 con 0x7fc554046ee0 2024-04-25T13:41:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc561532640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc5540d6b90 0x7fc554045a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.77:35702/0 (socket says 172.21.15.77:35702) 2024-04-25T13:41:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc561532640 1 -- 172.21.15.77:0/118073571 learned_addr learned my addr 172.21.15.77:0/118073571 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fe9c27fc640 1 -- 172.21.15.77:0/1468185915 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4017070 con 0x7fe9d00a88c0 2024-04-25T13:41:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fe9c27fc640 1 -- 172.21.15.77:0/1468185915 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c400c940 con 0x7fe9d00a88c0 2024-04-25T13:41:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fe9c27fc640 1 -- 172.21.15.77:0/1468185915 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400ccf0 con 0x7fe9d00a88c0 2024-04-25T13:41:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fe9d8072640 1 -- 172.21.15.77:0/1468185915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d00722e0 con 0x7fe9d00a88c0 2024-04-25T13:41:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fe9d8072640 1 -- 172.21.15.77:0/1468185915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d0074270 con 0x7fe9d00a88c0 2024-04-25T13:41:10.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fd2dffff640 1 -- 172.21.15.77:0/2445791969 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2ec05ae20 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f6f21d9b640 1 --2- 172.21.15.77:0/2054304751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f240a6ff0 0x7f6f240a7400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f240a6a00 tx=0x7f6f1c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9272b2aa069704e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afd537640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af814e970 0x7f0af81f2890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0af000ca20 tx=0x7f0af000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55bfff640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc554046ee0 0x7fc554006420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576002551 0 0) 0x7fc55402acb0 con 0x7fc5540d6b90 2024-04-25T13:41:10.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0aee7fc640 1 -- 172.21.15.77:0/2075517595 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0017070 con 0x7f0af814e970 2024-04-25T13:41:10.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af814da60 con 0x7f0af814e970 2024-04-25T13:41:10.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af81f0060 con 0x7f0af814e970 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc54c003530 con 0x7fc5540d6b90 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 <== mon.1 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3157586896 0 0) 0x7fc54c003530 con 0x7fc5540d6b90 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc554046ee0 msgr2=0x7fc554006420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc554046ee0 0x7fc554006420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 >> v2:172.21.15.96:3300/0 conn(0x7fc55404a810 msgr2=0x7fc55402a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 --2- 172.21.15.77:0/118073571 >> v2:172.21.15.96:3300/0 conn(0x7fc55404a810 0x7fc55402a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc554046140 con 0x7fc5540d6b90 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 <== mon.1 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fc550001680 con 0x7fc5540d6b90 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 >> v1:172.21.15.96:6789/0 conn(0x7fc5540d6b90 legacy=0x7fc554045a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc54c0039c0 0x7fc54c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc54c004810 0x7fc54c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc54c005280 0x7fc54c0141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540d5f90 con 0x7fc54c004810 2024-04-25T13:41:10.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc554046690 con 0x7fc54c0039c0 2024-04-25T13:41:10.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c0149e0 con 0x7fc54c005280 2024-04-25T13:41:10.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0aee7fc640 1 -- 172.21.15.77:0/2075517595 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af000abd0 con 0x7f0af814e970 2024-04-25T13:41:10.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f0aee7fc640 1 -- 172.21.15.77:0/2075517595 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0012400 con 0x7f0af814e970 2024-04-25T13:41:10.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f84749a9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470073a80 0x7f84700c0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f84749a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8470152430 0x7f8470152840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f84749a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8470074060 con 0x7f84700c18b0 2024-04-25T13:41:10.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f84749a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f84700c0dc0 con 0x7f8470152430 2024-04-25T13:41:10.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7f84749a9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f84700c0080 con 0x7f8470073a80 2024-04-25T13:41:10.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.599+0000 7fc55bfff640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc554046ee0 0x7fc554006420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:10.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fc55bfff640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc54c004810 0x7fc54c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f846effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f84700c18b0 0x7f847014e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59004/0 (socket says 172.21.15.77:59004) 2024-04-25T13:41:10.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f846effd640 1 -- 172.21.15.77:0/886138495 learned_addr learned my addr 172.21.15.77:0/886138495 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:10.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fc55bfff640 1 -- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc54c005280 msgr2=0x7fc54c0141e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:41:10.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fc55bfff640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc54c005280 0x7fc54c0141e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fc55bfff640 1 -- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc54c0039c0 msgr2=0x7fc54c003e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:41:10.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fc55bfff640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc54c0039c0 0x7fc54c003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fc55bfff640 1 -- 172.21.15.77:0/118073571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc554046140 con 0x7fc54c004810 2024-04-25T13:41:10.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fe9c27fc640 1 -- 172.21.15.77:0/1468185915 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe9c401a070 con 0x7fe9d00a88c0 2024-04-25T13:41:10.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fe9c27fc640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe9b406f400 0x7fe9b4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fe9c27fc640 1 -- 172.21.15.77:0/1468185915 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe9c408f180 con 0x7fe9d00a88c0 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fe9d560d640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe9b406f400 0x7fe9b4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fe9d8072640 1 -- 172.21.15.77:0/1468185915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b80052a0 con 0x7fe9d00a88c0 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f846ffff640 1 --2- 172.21.15.77:0/886138495 >> v2:172.21.15.77:3300/0 conn(0x7f8470152430 0x7f8470152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f846f7fe640 1 --2- 172.21.15.77:0/886138495 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470073a80 0x7f84700c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f846ffff640 1 -- 172.21.15.77:0/886138495 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470073a80 msgr2=0x7f84700c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f846ffff640 1 --2- 172.21.15.77:0/886138495 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470073a80 0x7f84700c0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f846ffff640 1 -- 172.21.15.77:0/886138495 >> v1:172.21.15.77:6789/0 conn(0x7f84700c18b0 legacy=0x7f847014e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f846ffff640 1 -- 172.21.15.77:0/886138495 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84700c0360 con 0x7f8470152430 2024-04-25T13:41:10.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f846f7fe640 1 --2- 172.21.15.77:0/886138495 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470073a80 0x7f84700c0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:10.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f0aee7fc640 1 -- 172.21.15.77:0/2075517595 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0af001a070 con 0x7f0af814e970 2024-04-25T13:41:10.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae00052a0 con 0x7f0af814e970 2024-04-25T13:41:10.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f0aee7fc640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0adc06f430 0x7f0adc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f0aee7fc640 1 -- 172.21.15.77:0/2075517595 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0af008eef0 con 0x7f0af814e970 2024-04-25T13:41:10.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f0afdd38640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0adc06f430 0x7f0adc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f0afdd38640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0adc06f430 0x7f0adc071940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0af401a040 tx=0x7f0af40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7fe9d560d640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe9b406f400 0x7fe9b4071910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8007fd0 tx=0x7fe9c8007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f6f2159a640 1 -- 172.21.15.77:0/2054304751 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0b2070 con 0x7f6f240a6ff0 2024-04-25T13:41:10.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f6f2159a640 1 -- 172.21.15.77:0/2054304751 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1c0a55e0 con 0x7f6f240a6ff0 2024-04-25T13:41:10.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.603+0000 7f6f2159a640 1 -- 172.21.15.77:0/2054304751 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14001680 con 0x7f6f240a6ff0 2024-04-25T13:41:10.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.607+0000 7f6f28b5f640 1 -- 172.21.15.77:0/2054304751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f240a6ff0 msgr2=0x7f6f240a7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.607+0000 7f6f28b5f640 1 --2- 172.21.15.77:0/2054304751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f240a6ff0 0x7f6f240a7400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f240a6a00 tx=0x7f6f1c01c890 comp rx=0 tx=0).stop 2024-04-25T13:41:10.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.607+0000 7fc55bfff640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc54c004810 0x7fc54c004c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc55c06af90 tx=0x7fc55c098e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5901d430aa1dcb10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.607+0000 7f846ffff640 1 --2- 172.21.15.77:0/886138495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470152430 0x7f8470152840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8468009d90 tx=0x7f846801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdb97c9f42796e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 -- 172.21.15.77:0/2054304751 shutdown_connections 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 --2- 172.21.15.77:0/2054304751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f240a6ff0 0x7f6f240a7400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 -- 172.21.15.77:0/2054304751 >> 172.21.15.77:0/2054304751 conn(0x7f6f240c36d0 msgr2=0x7f6f240c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 -- 172.21.15.77:0/2054304751 shutdown_connections 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 -- 172.21.15.77:0/2054304751 wait complete. 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 Processor -- start 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 -- start start 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f240a6ff0 0x7f6f241452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240a7b50 0x7f6f240733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24151a60 0x7f6f240719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24160a80 con 0x7f6f240a7b50 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24160900 con 0x7f6f24151a60 2024-04-25T13:41:10.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f28b5f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6f24160c00 con 0x7f6f240a6ff0 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f21d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240a7b50 0x7f6f240733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f21d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240a7b50 0x7f6f240733f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42338/0 (socket says 172.21.15.77:42338) 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f21d9b640 1 -- 172.21.15.77:0/4197222361 learned_addr learned my addr 172.21.15.77:0/4197222361 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f2259c640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f240a6ff0 0x7f6f241452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f22d9d640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24151a60 0x7f6f240719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f21d9b640 1 -- 172.21.15.77:0/4197222361 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f240a6ff0 msgr2=0x7f6f241452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f21d9b640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f240a6ff0 0x7f6f241452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f21d9b640 1 -- 172.21.15.77:0/4197222361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24151a60 msgr2=0x7f6f240719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f21d9b640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24151a60 0x7f6f240719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7fe9c27fc640 1 -- 172.21.15.77:0/1468185915 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9c405b980 con 0x7fe9d00a88c0 2024-04-25T13:41:10.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.611+0000 7f6f21d9b640 1 -- 172.21.15.77:0/4197222361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f241560f0 con 0x7f6f240a7b50 2024-04-25T13:41:10.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.615+0000 7f6f21d9b640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240a7b50 0x7f6f240733f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c01a4c0 tx=0x7f6f1c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f6f12ffd640 1 -- 172.21.15.77:0/4197222361 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0b2040 con 0x7f6f240a7b50 2024-04-25T13:41:10.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f0aee7fc640 1 -- 172.21.15.77:0/2075517595 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0af005b700 con 0x7f0af814e970 2024-04-25T13:41:10.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f6f12ffd640 1 -- 172.21.15.77:0/4197222361 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1c0bf070 con 0x7f6f240a7b50 2024-04-25T13:41:10.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f6f28b5f640 1 -- 172.21.15.77:0/4197222361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f241563d0 con 0x7f6f240a7b50 2024-04-25T13:41:10.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f6f28b5f640 1 -- 172.21.15.77:0/4197222361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f24072750 con 0x7f6f240a7b50 2024-04-25T13:41:10.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f6f12ffd640 1 -- 172.21.15.77:0/4197222361 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0aec20 con 0x7f6f240a7b50 2024-04-25T13:41:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f846e7fc640 1 -- 172.21.15.77:0/886138495 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84680b2070 con 0x7f8470152430 2024-04-25T13:41:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f846e7fc640 1 -- 172.21.15.77:0/886138495 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84680a5860 con 0x7f8470152430 2024-04-25T13:41:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f846e7fc640 1 -- 172.21.15.77:0/886138495 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84680a5c70 con 0x7f8470152430 2024-04-25T13:41:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c127070 con 0x7fc54c004810 2024-04-25T13:41:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c121a20 con 0x7fc54c004810 2024-04-25T13:41:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7fc55b7fe640 1 -- 172.21.15.77:0/118073571 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c127070 con 0x7fc54c004810 2024-04-25T13:41:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f6f10ff9640 1 -- 172.21.15.77:0/4197222361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6efc0052a0 con 0x7f6f240a7b50 2024-04-25T13:41:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f84749a9640 1 -- 172.21.15.77:0/886138495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470152430 msgr2=0x7f8470152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.623+0000 7f84749a9640 1 --2- 172.21.15.77:0/886138495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470152430 0x7f8470152840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8468009d90 tx=0x7f846801c990 comp rx=0 tx=0).stop 2024-04-25T13:41:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f84749a9640 1 -- 172.21.15.77:0/886138495 shutdown_connections 2024-04-25T13:41:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f84749a9640 1 --2- 172.21.15.77:0/886138495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470152430 0x7f8470152840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f84749a9640 1 --2- 172.21.15.77:0/886138495 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470073a80 0x7f84700c0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f84749a9640 1 -- 172.21.15.77:0/886138495 >> 172.21.15.77:0/886138495 conn(0x7f84700c4b00 msgr2=0x7f84700c0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f84749a9640 1 -- 172.21.15.77:0/886138495 shutdown_connections 2024-04-25T13:41:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f84749a9640 1 -- 172.21.15.77:0/886138495 wait complete. 2024-04-25T13:41:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7fc561d33640 1 -- 172.21.15.77:0/118073571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc54c004810 msgr2=0x7fc54c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7fc561d33640 1 --2- 172.21.15.77:0/118073571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc54c004810 0x7fc54c004c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc55c06af90 tx=0x7fc55c098e10 comp rx=0 tx=0).stop 2024-04-25T13:41:10.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f6f12ffd640 1 -- 172.21.15.77:0/4197222361 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6f1c0b8470 con 0x7f6f240a7b50 2024-04-25T13:41:10.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f6f12ffd640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f0406f400 0x7f6f04071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f6f2259c640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f0406f400 0x7f6f04071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f84749a9640 1 Processor -- start 2024-04-25T13:41:10.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f84749a9640 1 -- start start 2024-04-25T13:41:10.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.627+0000 7f6f2259c640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f0406f400 0x7f6f04071910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f18005890 tx=0x7f6f18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7fc561532640 1 -- 172.21.15.77:0/118073571 reap_dead start 2024-04-25T13:41:10.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7fc561d33640 1 -- 172.21.15.77:0/118073571 shutdown_connections 2024-04-25T13:41:10.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7fc561d33640 1 -- 172.21.15.77:0/118073571 >> 172.21.15.77:0/118073571 conn(0x7fc554048460 msgr2=0x7fc554048870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f6f12ffd640 1 -- 172.21.15.77:0/4197222361 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6f1c0f3c40 con 0x7f6f240a7b50 2024-04-25T13:41:10.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7fc561d33640 1 -- 172.21.15.77:0/118073571 shutdown_connections 2024-04-25T13:41:10.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f84749a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470073a80 0x7f8470150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f84749a9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84700c18b0 0x7f84700a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f84749a9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470152430 0x7f84701436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470073a80 0x7f8470150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470073a80 0x7f8470150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42342/0 (socket says 172.21.15.77:42342) 2024-04-25T13:41:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846f7fe640 1 -- 172.21.15.77:0/746090830 learned_addr learned my addr 172.21.15.77:0/746090830 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f847006cdc0 con 0x7f8470073a80 2024-04-25T13:41:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846effd640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84700c18b0 0x7f84700a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8470155780 con 0x7f84700c18b0 2024-04-25T13:41:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f847006cf40 con 0x7f8470152430 2024-04-25T13:41:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7fc561d33640 1 -- 172.21.15.77:0/118073571 wait complete. 2024-04-25T13:41:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7fc561d33640 1 Processor -- start 2024-04-25T13:41:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846ffff640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470152430 0x7f84701436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846f7fe640 1 -- 172.21.15.77:0/746090830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470152430 msgr2=0x7f84701436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846f7fe640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470152430 0x7f84701436e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846f7fe640 1 -- 172.21.15.77:0/746090830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84700c18b0 msgr2=0x7f84700a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846f7fe640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84700c18b0 0x7f84700a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846f7fe640 1 -- 172.21.15.77:0/746090830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847014ddf0 con 0x7f8470073a80 2024-04-25T13:41:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7f846f7fe640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470073a80 0x7f8470150ff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f846400e960 tx=0x7f846400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.631+0000 7fc561d33640 1 -- start start 2024-04-25T13:41:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc561d33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc554041e20 0x7fc5540d44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc561d33640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc55403f660 0x7fc55403fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc560d31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc554041e20 0x7fc5540d44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc560d31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc554041e20 0x7fc5540d44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42346/0 (socket says 172.21.15.77:42346) 2024-04-25T13:41:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7f8457fff640 1 -- 172.21.15.77:0/746090830 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464017070 con 0x7f8470073a80 2024-04-25T13:41:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc560d31640 1 -- 172.21.15.77:0/778082114 learned_addr learned my addr 172.21.15.77:0/778082114 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc561d33640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540d3670 0x7fc5540d3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc55400ab70 con 0x7fc554041e20 2024-04-25T13:41:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc55400a9f0 con 0x7fc5540d3670 2024-04-25T13:41:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc55400acf0 con 0x7fc55403f660 2024-04-25T13:41:10.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc55bfff640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc55403f660 0x7fc55403fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7f6f12ffd640 1 -- 172.21.15.77:0/4197222361 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f1c016480 con 0x7f6f240a7b50 2024-04-25T13:41:10.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc561532640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540d3670 0x7fc5540d3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc560d31640 1 -- 172.21.15.77:0/778082114 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc55403f660 msgr2=0x7fc55403fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc560d31640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc55403f660 0x7fc55403fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc560d31640 1 -- 172.21.15.77:0/778082114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540d3670 msgr2=0x7fc5540d3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc560d31640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540d3670 0x7fc5540d3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc560d31640 1 -- 172.21.15.77:0/778082114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55416c730 con 0x7fc554041e20 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7fc560d31640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc554041e20 0x7fc5540d44a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc54800b410 tx=0x7fc548009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847014e790 con 0x7f8470073a80 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8470151530 con 0x7f8470073a80 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.635+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f847014e9d0 con 0x7f8470073a80 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.639+0000 7f8457fff640 1 -- 172.21.15.77:0/746090830 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8464009400 con 0x7f8470073a80 2024-04-25T13:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.639+0000 7f8457fff640 1 -- 172.21.15.77:0/746090830 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464021060 con 0x7f8470073a80 2024-04-25T13:41:10.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7fc5597fa640 1 -- 172.21.15.77:0/778082114 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548015020 con 0x7fc554041e20 2024-04-25T13:41:10.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55416c3c0 con 0x7fc554041e20 2024-04-25T13:41:10.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5540d4190 con 0x7fc554041e20 2024-04-25T13:41:10.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7fc5597fa640 1 -- 172.21.15.77:0/778082114 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548011870 con 0x7fc554041e20 2024-04-25T13:41:10.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7f8457fff640 1 -- 172.21.15.77:0/746090830 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f846401a070 con 0x7f8470073a80 2024-04-25T13:41:10.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7f8457fff640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f845c06f430 0x7f845c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7f8457fff640 1 -- 172.21.15.77:0/746090830 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f846408f840 con 0x7f8470073a80 2024-04-25T13:41:10.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7f846effd640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f845c06f430 0x7f845c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7fc5597fa640 1 -- 172.21.15.77:0/778082114 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548011c60 con 0x7fc554041e20 2024-04-25T13:41:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53c0052a0 con 0x7fc554041e20 2024-04-25T13:41:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.643+0000 7f846effd640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f845c06f430 0x7f845c071940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84700a3b90 tx=0x7f8460007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.647+0000 7f8457fff640 1 -- 172.21.15.77:0/746090830 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f847014e9d0 con 0x7f8470073a80 2024-04-25T13:41:10.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.647+0000 7fc5597fa640 1 -- 172.21.15.77:0/778082114 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc548018020 con 0x7fc554041e20 2024-04-25T13:41:10.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.647+0000 7fc5597fa640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc54006f4d0 0x7fc5400719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.647+0000 7fc5597fa640 1 -- 172.21.15.77:0/778082114 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc54808f0d0 con 0x7fc554041e20 2024-04-25T13:41:10.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.651+0000 7fc55bfff640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc54006f4d0 0x7fc5400719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.651+0000 7fc55bfff640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc54006f4d0 0x7fc5400719e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc54c014930 tx=0x7fc55c06a600 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.651+0000 7fc5597fa640 1 -- 172.21.15.77:0/778082114 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc54801f030 con 0x7fc554041e20 2024-04-25T13:41:10.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe24d891640 1 Processor -- start 2024-04-25T13:41:10.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe24d891640 1 -- start start 2024-04-25T13:41:10.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe24d891640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe240046230 0x7fe2400417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe24d891640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 0x7fe2400d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe24d891640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2400d6420 con 0x7fe240006660 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe24d891640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe2400d23f0 con 0x7fe240046230 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe24d891640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe2400d60f0 con 0x7fe2400d1ee0 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe246ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe240046230 0x7fe2400417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe246ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe240046230 0x7fe2400417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42356/0 (socket says 172.21.15.77:42356) 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe2467fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe240006660 0x7fe2400d17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59020/0 (socket says 172.21.15.77:59020) 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe246ffd640 1 -- 172.21.15.77:0/766781527 learned_addr learned my addr 172.21.15.77:0/766781527 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe2477fe640 1 --2- 172.21.15.77:0/766781527 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 0x7fe2400d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe246ffd640 1 -- 172.21.15.77:0/766781527 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 msgr2=0x7fe2400d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe246ffd640 1 --2- 172.21.15.77:0/766781527 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 0x7fe2400d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe246ffd640 1 -- 172.21.15.77:0/766781527 >> v1:172.21.15.77:6789/0 conn(0x7fe240006660 legacy=0x7fe2400d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7fe246ffd640 1 -- 172.21.15.77:0/766781527 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe240006a70 con 0x7fe240046230 2024-04-25T13:41:10.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7ff893fff640 1 Processor -- start 2024-04-25T13:41:10.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.659+0000 7ff893fff640 1 -- start start 2024-04-25T13:41:10.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff893fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff88c043db0 0x7ff88c02da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff893fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88c0441c0 con 0x7ff88c009240 2024-04-25T13:41:10.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff893fff640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88c046e10 con 0x7ff88c008e30 2024-04-25T13:41:10.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff893fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff88c0478b0 con 0x7ff88c043db0 2024-04-25T13:41:10.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff892ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff88c043db0 0x7ff88c02da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff892ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff88c043db0 0x7ff88c02da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42358/0 (socket says 172.21.15.77:42358) 2024-04-25T13:41:10.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff892ffd640 1 -- 172.21.15.77:0/3209946602 learned_addr learned my addr 172.21.15.77:0/3209946602 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff892ffd640 1 -- 172.21.15.77:0/3209946602 >> v1:172.21.15.96:6789/0 conn(0x7ff88c008e30 legacy=0x7ff88c045ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:41:10.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff892ffd640 1 -- 172.21.15.77:0/3209946602 >> v1:172.21.15.77:6789/0 conn(0x7ff88c009240 legacy=0x7ff88c046700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:10.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7ff892ffd640 1 -- 172.21.15.77:0/3209946602 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c0d7220 con 0x7ff88c043db0 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7fe246ffd640 1 --2- 172.21.15.77:0/766781527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240046230 0x7fe2400417b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe23c006fd0 tx=0x7fe23c020bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b0d24882b98fef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7fe245ffb640 1 -- 172.21.15.77:0/766781527 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0af070 con 0x7fe240046230 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7fe245ffb640 1 -- 172.21.15.77:0/766781527 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c0a9bf0 con 0x7fe240046230 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7fe245ffb640 1 -- 172.21.15.77:0/766781527 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c004230 con 0x7fe240046230 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7fe24d891640 1 -- 172.21.15.77:0/766781527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240046230 msgr2=0x7fe2400417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.663+0000 7fe24d891640 1 --2- 172.21.15.77:0/766781527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240046230 0x7fe2400417b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe23c006fd0 tx=0x7fe23c020bd0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.667+0000 7fe24d891640 1 -- 172.21.15.77:0/766781527 shutdown_connections 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.667+0000 7fe24d891640 1 --2- 172.21.15.77:0/766781527 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 0x7fe2400d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.667+0000 7fe24d891640 1 --2- 172.21.15.77:0/766781527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240046230 0x7fe2400417b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.667+0000 7fe24d891640 1 -- 172.21.15.77:0/766781527 >> 172.21.15.77:0/766781527 conn(0x7fe240028f70 msgr2=0x7fe240029380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.667+0000 7ff892ffd640 1 --2- 172.21.15.77:0/3209946602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 0x7ff88c02da90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff894051a60 tx=0x7ff89409af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785d9947b07fea86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.667+0000 7fe24d891640 1 -- 172.21.15.77:0/766781527 shutdown_connections 2024-04-25T13:41:10.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.667+0000 7fe24d891640 1 -- 172.21.15.77:0/766781527 wait complete. 2024-04-25T13:41:10.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.667+0000 7fe24d891640 1 Processor -- start 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe24d891640 1 -- start start 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe24d891640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240006660 0x7fe24002bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe246ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240006660 0x7fe24002bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe246ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240006660 0x7fe24002bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42374/0 (socket says 172.21.15.77:42374) 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe246ffd640 1 -- 172.21.15.77:0/2686123939 learned_addr learned my addr 172.21.15.77:0/2686123939 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe24d891640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe240046230 0x7fe2400d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe24d891640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 0x7fe2400d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400df5c0 con 0x7fe240006660 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400df440 con 0x7fe240046230 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe2400df740 con 0x7fe2400d1ee0 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe2467fc640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe240046230 0x7fe2400d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe2477fe640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 0x7fe2400d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe246ffd640 1 -- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 msgr2=0x7fe2400d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe246ffd640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 0x7fe2400d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe246ffd640 1 -- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe240046230 msgr2=0x7fe2400d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe246ffd640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe240046230 0x7fe2400d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe246ffd640 1 -- 172.21.15.77:0/2686123939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe240191d30 con 0x7fe240006660 2024-04-25T13:41:10.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe246ffd640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240006660 0x7fe24002bc00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe23c000c10 tx=0x7fe23c01d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe22ffff640 1 -- 172.21.15.77:0/2686123939 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0af040 con 0x7fe240006660 2024-04-25T13:41:10.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe22ffff640 1 -- 172.21.15.77:0/2686123939 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c010170 con 0x7fe240006660 2024-04-25T13:41:10.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe22ffff640 1 -- 172.21.15.77:0/2686123939 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c010580 con 0x7fe240006660 2024-04-25T13:41:10.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.671+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24003e9a0 con 0x7fe240006660 2024-04-25T13:41:10.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7ff891ffb640 1 -- 172.21.15.77:0/3209946602 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894130070 con 0x7ff88c043db0 2024-04-25T13:41:10.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.675+0000 7fe22ffff640 1 -- 172.21.15.77:0/2686123939 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe23c00d480 con 0x7fe240006660 2024-04-25T13:41:10.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.675+0000 7fe22ffff640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe23406f430 0x7fe234071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7ff891ffb640 1 -- 172.21.15.77:0/3209946602 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff894123cf0 con 0x7ff88c043db0 2024-04-25T13:41:10.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.675+0000 7fe2467fc640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe23406f430 0x7fe234071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.675+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe240040860 con 0x7fe240006660 2024-04-25T13:41:10.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.675+0000 7fe22ffff640 1 -- 172.21.15.77:0/2686123939 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe23c1278b0 con 0x7fe240006660 2024-04-25T13:41:10.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7fe2467fc640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe23406f430 0x7fe234071940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe238005030 tx=0x7fe238004e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe240169500 con 0x7fe240006660 2024-04-25T13:41:10.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7ff893fff640 1 -- 172.21.15.77:0/3209946602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 msgr2=0x7ff88c02da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7ff893fff640 1 --2- 172.21.15.77:0/3209946602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 0x7ff88c02da90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff894051a60 tx=0x7ff89409af30 comp rx=0 tx=0).stop 2024-04-25T13:41:10.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7ff893fff640 1 -- 172.21.15.77:0/3209946602 shutdown_connections 2024-04-25T13:41:10.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7ff893fff640 1 --2- 172.21.15.77:0/3209946602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 0x7ff88c02da90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7ff893fff640 1 -- 172.21.15.77:0/3209946602 >> 172.21.15.77:0/3209946602 conn(0x7ff88c00b750 msgr2=0x7ff88c00bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7ff893fff640 1 -- 172.21.15.77:0/3209946602 shutdown_connections 2024-04-25T13:41:10.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.679+0000 7ff893fff640 1 -- 172.21.15.77:0/3209946602 wait complete. 2024-04-25T13:41:10.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.683+0000 7ff893fff640 1 Processor -- start 2024-04-25T13:41:10.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.683+0000 7ff893fff640 1 -- start start 2024-04-25T13:41:10.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.683+0000 7ff893fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c008e30 0x7ff88c0cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.683+0000 7ff893fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff88c009240 0x7ff88c025660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.683+0000 7ff893fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 0x7ff88c025ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.683+0000 7ff892ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c008e30 0x7ff88c0cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.683+0000 7ff892ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c008e30 0x7ff88c0cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:55678/0 (socket says 172.21.15.77:55678) 2024-04-25T13:41:10.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.683+0000 7ff8927fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff88c009240 0x7ff88c025660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff8927fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff88c009240 0x7ff88c025660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:33574/0 (socket says 172.21.15.77:33574) 2024-04-25T13:41:10.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff8937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 0x7ff88c025ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff8937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 0x7ff88c025ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42390/0 (socket says 172.21.15.77:42390) 2024-04-25T13:41:10.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff892ffd640 1 -- 172.21.15.77:0/737396363 learned_addr learned my addr 172.21.15.77:0/737396363 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:10.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c007970 con 0x7ff88c043db0 2024-04-25T13:41:10.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c0077f0 con 0x7ff88c008e30 2024-04-25T13:41:10.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff88c007af0 con 0x7ff88c009240 2024-04-25T13:41:10.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff8937fe640 1 -- 172.21.15.77:0/737396363 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff88c009240 msgr2=0x7ff88c025660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff8937fe640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff88c009240 0x7ff88c025660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff8937fe640 1 -- 172.21.15.77:0/737396363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c008e30 msgr2=0x7ff88c0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff8937fe640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c008e30 0x7ff88c0cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff8937fe640 1 -- 172.21.15.77:0/737396363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c177df0 con 0x7ff88c043db0 2024-04-25T13:41:10.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff8937fe640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 0x7ff88c025ba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff88800b3e0 tx=0x7ff88800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7fe22ffff640 1 -- 172.21.15.77:0/2686123939 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe23c0eee70 con 0x7fe240006660 2024-04-25T13:41:10.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff87b7fe640 1 -- 172.21.15.77:0/737396363 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888015020 con 0x7ff88c043db0 2024-04-25T13:41:10.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff87b7fe640 1 -- 172.21.15.77:0/737396363 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff888011830 con 0x7ff88c043db0 2024-04-25T13:41:10.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff87b7fe640 1 -- 172.21.15.77:0/737396363 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888011c20 con 0x7ff88c043db0 2024-04-25T13:41:10.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c177870 con 0x7ff88c043db0 2024-04-25T13:41:10.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.687+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c177b10 con 0x7ff88c043db0 2024-04-25T13:41:10.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.691+0000 7ff87b7fe640 1 -- 172.21.15.77:0/737396363 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff888018020 con 0x7ff88c043db0 2024-04-25T13:41:10.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.691+0000 7ff87b7fe640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff87c06f590 0x7ff87c071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:10.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.691+0000 7ff892ffd640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff87c06f590 0x7ff87c071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:10.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.691+0000 7ff87b7fe640 1 -- 172.21.15.77:0/737396363 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff888011dc0 con 0x7ff88c043db0 2024-04-25T13:41:10.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.695+0000 7ff892ffd640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff87c06f590 0x7ff87c071aa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff8940660c0 tx=0x7ff894125070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:10.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.695+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8740052a0 con 0x7ff88c043db0 2024-04-25T13:41:10.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.703+0000 7ff87b7fe640 1 -- 172.21.15.77:0/737396363 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff88801f020 con 0x7ff88c043db0 2024-04-25T13:41:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.919+0000 7fd2fdb27640 1 -- 172.21.15.77:0/2445791969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd2d8005590 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.923+0000 7fd2dffff640 1 -- 172.21.15.77:0/2445791969 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd2ec05f120 con 0x7fd2f80c0bf0 2024-04-25T13:41:10.926 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.923+0000 7fd2ddffb640 1 -- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2e406f430 msgr2=0x7fd2e4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.923+0000 7fd2ddffb640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2e406f430 0x7fd2e4071940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80702a0 tx=0x7fd2e8009190 comp rx=0 tx=0).stop 2024-04-25T13:41:10.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 -- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f80c0bf0 msgr2=0x7fd2f813eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f80c0bf0 0x7fd2f813eb80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00c3c0 tx=0x7fd2ec00c880 comp rx=0 tx=0).stop 2024-04-25T13:41:10.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 -- 172.21.15.77:0/2445791969 shutdown_connections 2024-04-25T13:41:10.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2e406f430 0x7fd2e4071940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f80c0bf0 0x7fd2f813eb80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2f80a8be0 0x7fd2f8144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 --2- 172.21.15.77:0/2445791969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2f8071de0 0x7fd2f8147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 -- 172.21.15.77:0/2445791969 >> 172.21.15.77:0/2445791969 conn(0x7fd2f80c00d0 msgr2=0x7fd2f8150710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 -- 172.21.15.77:0/2445791969 shutdown_connections 2024-04-25T13:41:10.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.927+0000 7fd2ddffb640 1 -- 172.21.15.77:0/2445791969 wait complete. 2024-04-25T13:41:10.938 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.931+0000 7fe9d8072640 1 -- 172.21.15.77:0/1468185915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe9b8005590 con 0x7fe9d00a88c0 2024-04-25T13:41:10.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.931+0000 7fe9c27fc640 1 -- 172.21.15.77:0/1468185915 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9c405fc80 con 0x7fe9d00a88c0 2024-04-25T13:41:10.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 -- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe9b406f400 msgr2=0x7fe9b4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe9b406f400 0x7fe9b4071910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8007fd0 tx=0x7fe9c8007ce0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 -- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d00a88c0 msgr2=0x7fe9d0071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d00a88c0 0x7fe9d0071da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400e8a0 tx=0x7fe9c400eca0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 -- 172.21.15.77:0/1468185915 shutdown_connections 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe9b406f400 0x7fe9b4071910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe9d0156b60 0x7fe9d0073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9d0155b40 0x7fe9d00737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 --2- 172.21.15.77:0/1468185915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9d00a88c0 0x7fe9d0071da0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 -- 172.21.15.77:0/1468185915 >> 172.21.15.77:0/1468185915 conn(0x7fe9d00c04d0 msgr2=0x7fe9d00c14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 -- 172.21.15.77:0/1468185915 shutdown_connections 2024-04-25T13:41:10.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.939+0000 7fe9b3fff640 1 -- 172.21.15.77:0/1468185915 wait complete. 2024-04-25T13:41:10.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.947+0000 7f6f10ff9640 1 -- 172.21.15.77:0/4197222361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6efc005860 con 0x7f6f240a7b50 2024-04-25T13:41:10.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.951+0000 7f6f12ffd640 1 -- 172.21.15.77:0/4197222361 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f1c0f75f0 con 0x7f6f240a7b50 2024-04-25T13:41:10.951 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 -- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f0406f400 msgr2=0x7f6f04071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f0406f400 0x7f6f04071910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f18005890 tx=0x7f6f18009040 comp rx=0 tx=0).stop 2024-04-25T13:41:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 -- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240a7b50 msgr2=0x7f6f240733f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240a7b50 0x7f6f240733f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c01a4c0 tx=0x7f6f1c019630 comp rx=0 tx=0).stop 2024-04-25T13:41:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 -- 172.21.15.77:0/4197222361 shutdown_connections 2024-04-25T13:41:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f0406f400 0x7f6f04071910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f24151a60 0x7f6f240719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240a7b50 0x7f6f240733f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 --2- 172.21.15.77:0/4197222361 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f240a6ff0 0x7f6f241452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 -- 172.21.15.77:0/4197222361 >> 172.21.15.77:0/4197222361 conn(0x7f6f240c36d0 msgr2=0x7f6f240756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-04-25T13:41:10.959 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:10.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 -- 172.21.15.77:0/4197222361 shutdown_connections 2024-04-25T13:41:10.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.955+0000 7f6f28b5f640 1 -- 172.21.15.77:0/4197222361 wait complete. 2024-04-25T13:41:10.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.959+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0ae0005590 con 0x7f0af814e970 2024-04-25T13:41:10.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.959+0000 7f0aee7fc640 1 -- 172.21.15.77:0/2075517595 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0af005fa00 con 0x7f0af814e970 2024-04-25T13:41:10.960 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.959+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0adc06f430 msgr2=0x7f0adc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.959+0000 7f0afed3a640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0adc06f430 0x7f0adc071940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0af401a040 tx=0x7f0af40a6000 comp rx=0 tx=0).stop 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.959+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af814e970 msgr2=0x7f0af81f2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.959+0000 7f0afed3a640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af814e970 0x7f0af81f2890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0af000ca20 tx=0x7f0af000cee0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.963+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 shutdown_connections 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.963+0000 7f0afed3a640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0adc06f430 0x7f0adc071940 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.963+0000 7f0afed3a640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0af8152080 0x7f0af81f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.963+0000 7f0afed3a640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af814e970 0x7f0af81f2890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.963+0000 7f0afed3a640 1 --2- 172.21.15.77:0/2075517595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0af80c3ee0 0x7f0af80a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.963+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 >> 172.21.15.77:0/2075517595 conn(0x7f0af80c33c0 msgr2=0x7f0af8072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.963+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 shutdown_connections 2024-04-25T13:41:10.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.963+0000 7f0afed3a640 1 -- 172.21.15.77:0/2075517595 wait complete. 2024-04-25T13:41:10.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-04-25T13:41:10.968 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:10.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.975+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f847006a1a0 con 0x7f8470073a80 2024-04-25T13:41:10.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.975+0000 7f8457fff640 1 -- 172.21.15.77:0/746090830 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f846405c150 con 0x7f8470073a80 2024-04-25T13:41:10.975 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f845c06f430 msgr2=0x7f845c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f845c06f430 0x7f845c071940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84700a3b90 tx=0x7f8460007e90 comp rx=0 tx=0).stop 2024-04-25T13:41:10.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470073a80 msgr2=0x7f8470150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470073a80 0x7f8470150ff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f846400e960 tx=0x7f846400ee20 comp rx=0 tx=0).stop 2024-04-25T13:41:10.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 shutdown_connections 2024-04-25T13:41:10.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f845c06f430 0x7f845c071940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8470152430 0x7f84701436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84700c18b0 0x7f84700a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 --2- 172.21.15.77:0/746090830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8470073a80 0x7f8470150ff0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 >> 172.21.15.77:0/746090830 conn(0x7f84700c4b00 msgr2=0x7f84700c2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 shutdown_connections 2024-04-25T13:41:10.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.979+0000 7f84749a9640 1 -- 172.21.15.77:0/746090830 wait complete. 2024-04-25T13:41:10.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-25T13:41:10.985 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:10.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-04-25T13:41:10.988 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:10.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.987+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc53c005860 con 0x7fc554041e20 2024-04-25T13:41:10.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.987+0000 7fc5597fa640 1 -- 172.21.15.77:0/778082114 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc54805b9e0 con 0x7fc554041e20 2024-04-25T13:41:10.989 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc54006f4d0 msgr2=0x7fc5400719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc54006f4d0 0x7fc5400719e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc54c014930 tx=0x7fc55c06a600 comp rx=0 tx=0).stop 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc554041e20 msgr2=0x7fc5540d44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc554041e20 0x7fc5540d44a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc54800b410 tx=0x7fc548009f90 comp rx=0 tx=0).stop 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 shutdown_connections 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc54006f4d0 0x7fc5400719e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540d3670 0x7fc5540d3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc55403f660 0x7fc55403fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 --2- 172.21.15.77:0/778082114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc554041e20 0x7fc5540d44a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 >> 172.21.15.77:0/778082114 conn(0x7fc554048460 msgr2=0x7fc5540da6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 shutdown_connections 2024-04-25T13:41:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7fc561d33640 1 -- 172.21.15.77:0/778082114 wait complete. 2024-04-25T13:41:10.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.991+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff874005590 con 0x7ff88c043db0 2024-04-25T13:41:10.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff87b7fe640 1 -- 172.21.15.77:0/737396363 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff88805b860 con 0x7ff88c043db0 2024-04-25T13:41:10.995 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff87c06f590 msgr2=0x7ff87c071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff87c06f590 0x7ff87c071aa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff8940660c0 tx=0x7ff894125070 comp rx=0 tx=0).stop 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 msgr2=0x7ff88c025ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 0x7ff88c025ba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff88800b3e0 tx=0x7ff88800b8a0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 shutdown_connections 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff87c06f590 0x7ff87c071aa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c043db0 0x7ff88c025ba0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff88c009240 0x7ff88c025660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 --2- 172.21.15.77:0/737396363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff88c008e30 0x7ff88c0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:10.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 >> 172.21.15.77:0/737396363 conn(0x7ff88c00b750 msgr2=0x7ff88c02cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:10.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 shutdown_connections 2024-04-25T13:41:10.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:10.995+0000 7ff893fff640 1 -- 172.21.15.77:0/737396363 wait complete. 2024-04-25T13:41:11.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-04-25T13:41:11.003 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:11.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.011+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe240009050 con 0x7fe240006660 2024-04-25T13:41:11.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.011+0000 7fe22ffff640 1 -- 172.21.15.77:0/2686123939 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe23c0f6e20 con 0x7fe240006660 2024-04-25T13:41:11.013 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-25T13:41:11.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe23406f430 msgr2=0x7fe234071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe23406f430 0x7fe234071940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe238005030 tx=0x7fe238004e40 comp rx=0 tx=0).stop 2024-04-25T13:41:11.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240006660 msgr2=0x7fe24002bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240006660 0x7fe24002bc00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe23c000c10 tx=0x7fe23c01d970 comp rx=0 tx=0).stop 2024-04-25T13:41:11.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 shutdown_connections 2024-04-25T13:41:11.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe23406f430 0x7fe234071940 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2400d1ee0 0x7fe2400d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe240046230 0x7fe2400d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 --2- 172.21.15.77:0/2686123939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe240006660 0x7fe24002bc00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 >> 172.21.15.77:0/2686123939 conn(0x7fe240028f70 msgr2=0x7fe240168930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:11.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-04-25T13:41:11.018 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:11.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 shutdown_connections 2024-04-25T13:41:11.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.015+0000 7fe24d891640 1 -- 172.21.15.77:0/2686123939 wait complete. 2024-04-25T13:41:11.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-04-25T13:41:11.022 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:11.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-04-25T13:41:11.034 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:11.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:41:11.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:41:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce1ab27640 1 Processor -- start 2024-04-25T13:41:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce1ab27640 1 -- start start 2024-04-25T13:41:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce1ab27640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 0x7fce14152d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce1ab27640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce140c3200 con 0x7fce14153250 2024-04-25T13:41:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce1ab27640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce140c34e0 con 0x7fce140c6100 2024-04-25T13:41:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce1ab27640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fce140c37c0 con 0x7fce1406dae0 2024-04-25T13:41:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce190c4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fce14153250 0x7fce14155fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59038/0 (socket says 172.21.15.77:59038) 2024-04-25T13:41:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce190c4640 1 -- 172.21.15.77:0/2328278521 learned_addr learned my addr 172.21.15.77:0/2328278521 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce13fff640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 0x7fce14152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785360765 0 0) 0x7fce140c3200 con 0x7fce14153250 2024-04-25T13:41:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce00003530 con 0x7fce14153250 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1519751281 0 0) 0x7fce00003530 con 0x7fce14153250 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 msgr2=0x7fce14152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 0x7fce14152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 >> v1:172.21.15.96:6789/0 conn(0x7fce140c6100 legacy=0x7fce14152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce14153660 con 0x7fce14153250 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fce0c001a00 con 0x7fce14153250 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce13fff640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 0x7fce14152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 >> v1:172.21.15.77:6789/0 conn(0x7fce14153250 legacy=0x7fce14155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce000039f0 0x7fce00003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce00004810 0x7fce00004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 0x7fce000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce140c37c0 con 0x7fce000039f0 2024-04-25T13:41:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fce0000bad0 con 0x7fce00004810 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fce0000bcd0 con 0x7fce1406dae0 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.207+0000 7fce188c3640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce000039f0 0x7fce00003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce190c4640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 0x7fce000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce188c3640 1 -- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 msgr2=0x7fce000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce188c3640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 0x7fce000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce13fff640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce00004810 0x7fce00004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce188c3640 1 -- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce00004810 msgr2=0x7fce00004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce188c3640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce00004810 0x7fce00004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce188c3640 1 -- 172.21.15.77:0/2328278521 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce00003530 con 0x7fce000039f0 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce190c4640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce1406dae0 0x7fce000051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce188c3640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce000039f0 0x7fce00003e60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce04001750 tx=0x7fce0401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6449f86ad7aa81e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040013a0 con 0x7fce000039f0 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce040052f0 con 0x7fce000039f0 2024-04-25T13:41:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce137fe640 1 -- 172.21.15.77:0/2328278521 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04003840 con 0x7fce000039f0 2024-04-25T13:41:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce1ab27640 1 -- 172.21.15.77:0/2328278521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce000039f0 msgr2=0x7fce00003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce1ab27640 1 --2- 172.21.15.77:0/2328278521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce000039f0 0x7fce00003e60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce04001750 tx=0x7fce0401c3e0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce190c4640 1 -- 172.21.15.77:0/2328278521 reap_dead start 2024-04-25T13:41:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce1ab27640 1 -- 172.21.15.77:0/2328278521 shutdown_connections 2024-04-25T13:41:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce1ab27640 1 -- 172.21.15.77:0/2328278521 >> 172.21.15.77:0/2328278521 conn(0x7fce140c79c0 msgr2=0x7fce140c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce1ab27640 1 -- 172.21.15.77:0/2328278521 shutdown_connections 2024-04-25T13:41:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.211+0000 7fce1ab27640 1 -- 172.21.15.77:0/2328278521 wait complete. 2024-04-25T13:41:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 Processor -- start 2024-04-25T13:41:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 -- start start 2024-04-25T13:41:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce000039f0 0x7fce14159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce14157fe0 0x7fce141583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce141eec70 0x7fce141ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce140ad7c0 con 0x7fce141eec70 2024-04-25T13:41:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fce140ad640 con 0x7fce14157fe0 2024-04-25T13:41:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fce14158930 con 0x7fce000039f0 2024-04-25T13:41:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce190c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce141eec70 0x7fce141ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce190c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce141eec70 0x7fce141ef080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42412/0 (socket says 172.21.15.77:42412) 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce190c4640 1 -- 172.21.15.77:0/3191909117 learned_addr learned my addr 172.21.15.77:0/3191909117 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce188c3640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce000039f0 0x7fce14159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce13fff640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce14157fe0 0x7fce141583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce190c4640 1 -- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce000039f0 msgr2=0x7fce14159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce190c4640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce000039f0 0x7fce14159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce190c4640 1 -- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce14157fe0 msgr2=0x7fce141583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce190c4640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce14157fe0 0x7fce141583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce190c4640 1 -- 172.21.15.77:0/3191909117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce140c0450 con 0x7fce141eec70 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce13fff640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce14157fe0 0x7fce141583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce188c3640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce000039f0 0x7fce14159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce190c4640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce141eec70 0x7fce141ef080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce0c001590 tx=0x7fce0c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce117fa640 1 -- 172.21.15.77:0/3191909117 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00bb80 con 0x7fce141eec70 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce117fa640 1 -- 172.21.15.77:0/3191909117 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c00bd20 con 0x7fce141eec70 2024-04-25T13:41:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce140a6560 con 0x7fce141eec70 2024-04-25T13:41:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce117fa640 1 -- 172.21.15.77:0/3191909117 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0072b0 con 0x7fce141eec70 2024-04-25T13:41:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1414e0a0 con 0x7fce141eec70 2024-04-25T13:41:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.215+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1406a280 con 0x7fce141eec70 2024-04-25T13:41:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.219+0000 7fce117fa640 1 -- 172.21.15.77:0/3191909117 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fce0c01b060 con 0x7fce141eec70 2024-04-25T13:41:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.219+0000 7fce117fa640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcdf406f400 0x7fcdf4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.219+0000 7fce117fa640 1 -- 172.21.15.77:0/3191909117 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce0c08f310 con 0x7fce141eec70 2024-04-25T13:41:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.219+0000 7fce188c3640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcdf406f400 0x7fcdf4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.219+0000 7fce188c3640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcdf406f400 0x7fcdf4071910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce00004790 tx=0x7fce040011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:11.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.223+0000 7fce117fa640 1 -- 172.21.15.77:0/3191909117 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce0c05c290 con 0x7fce141eec70 2024-04-25T13:41:11.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.367+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce1414e330 con 0x7fcdf406f400 2024-04-25T13:41:11.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.379+0000 7fce117fa640 1 -- 172.21.15.77:0/3191909117 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251902 (secure 0 0 0) 0x7fce1414e330 con 0x7fcdf406f400 2024-04-25T13:41:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T13:41:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcdf406f400 msgr2=0x7fcdf4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcdf406f400 0x7fcdf4071910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce00004790 tx=0x7fce040011a0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce141eec70 msgr2=0x7fce141ef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce141eec70 0x7fce141ef080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce0c001590 tx=0x7fce0c00b4a0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 shutdown_connections 2024-04-25T13:41:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcdf406f400 0x7fcdf4071910 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce141eec70 0x7fce141ef080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce14157fe0 0x7fce141583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 --2- 172.21.15.77:0/3191909117 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce000039f0 0x7fce14159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 >> 172.21.15.77:0/3191909117 conn(0x7fce140c79c0 msgr2=0x7fce1414ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:11.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 shutdown_connections 2024-04-25T13:41:11.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.383+0000 7fce1ab27640 1 -- 172.21.15.77:0/3191909117 wait complete. 2024-04-25T13:41:11.403 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T13:41:10.366826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218076,"kb_used_data":1888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756644,"statfs":{"total":773094113280,"available":772870803456,"internally_reserved":0,"allocated":1933312,"data_stored":1790396,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.980368"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376520+0000","last_change":"2024-04-25T13:41:04.470225+0000","last_active":"2024-04-25T13:41:06.376520+0000","last_peered":"2024-04-25T13:41:06.376520+0000","last_clean":"2024-04-25T13:41:06.376520+0000","last_became_active":"2024-04-25T13:41:04.434108+0000","last_became_peered":"2024-04-25T13:41:04.434108+0000","last_unstale":"2024-04-25T13:41:06.376520+0000","last_undegraded":"2024-04-25T13:41:06.376520+0000","last_fullsized":"2024-04-25T13:41:06.376520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394570+0000","last_change":"2024-04-25T13:41:04.422886+0000","last_active":"2024-04-25T13:41:05.394570+0000","last_peered":"2024-04-25T13:41:05.394570+0000","last_clean":"2024-04-25T13:41:05.394570+0000","last_became_active":"2024-04-25T13:41:04.422546+0000","last_became_peered":"2024-04-25T13:41:04.422546+0000","last_unstale":"2024-04-25T13:41:05.394570+0000","last_undegraded":"2024-04-25T13:41:05.394570+0000","last_fullsized":"2024-04-25T13:41:05.394570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080522+0000","last_change":"2024-04-25T13:41:04.413021+0000","last_active":"2024-04-25T13:41:07.080522+0000","last_peered":"2024-04-25T13:41:07.080522+0000","last_clean":"2024-04-25T13:41:07.080522+0000","last_became_active":"2024-04-25T13:41:04.412382+0000","last_became_peered":"2024-04-25T13:41:04.412382+0000","last_unstale":"2024-04-25T13:41:07.080522+0000","last_undegraded":"2024-04-25T13:41:07.080522+0000","last_fullsized":"2024-04-25T13:41:07.080522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398030+0000","last_change":"2024-04-25T13:41:04.419756+0000","last_active":"2024-04-25T13:41:05.398030+0000","last_peered":"2024-04-25T13:41:05.398030+0000","last_clean":"2024-04-25T13:41:05.398030+0000","last_became_active":"2024-04-25T13:41:04.418367+0000","last_became_peered":"2024-04-25T13:41:04.418367+0000","last_unstale":"2024-04-25T13:41:05.398030+0000","last_undegraded":"2024-04-25T13:41:05.398030+0000","last_fullsized":"2024-04-25T13:41:05.398030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375397+0000","last_change":"2024-04-25T13:41:04.428788+0000","last_active":"2024-04-25T13:41:06.375397+0000","last_peered":"2024-04-25T13:41:06.375397+0000","last_clean":"2024-04-25T13:41:06.375397+0000","last_became_active":"2024-04-25T13:41:04.428424+0000","last_became_peered":"2024-04-25T13:41:04.428424+0000","last_unstale":"2024-04-25T13:41:06.375397+0000","last_undegraded":"2024-04-25T13:41:06.375397+0000","last_fullsized":"2024-04-25T13:41:06.375397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397757+0000","last_change":"2024-04-25T13:41:04.432387+0000","last_active":"2024-04-25T13:41:05.397757+0000","last_peered":"2024-04-25T13:41:05.397757+0000","last_clean":"2024-04-25T13:41:05.397757+0000","last_became_active":"2024-04-25T13:41:04.431971+0000","last_became_peered":"2024-04-25T13:41:04.431971+0000","last_unstale":"2024-04-25T13:41:05.397757+0000","last_undegraded":"2024-04-25T13:41:05.397757+0000","last_fullsized":"2024-04-25T13:41:05.397757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375149+0000","last_change":"2024-04-25T13:41:04.473786+0000","last_active":"2024-04-25T13:41:06.375149+0000","last_peered":"2024-04-25T13:41:06.375149+0000","last_clean":"2024-04-25T13:41:06.375149+0000","last_became_active":"2024-04-25T13:41:04.471082+0000","last_became_peered":"2024-04-25T13:41:04.471082+0000","last_unstale":"2024-04-25T13:41:06.375149+0000","last_undegraded":"2024-04-25T13:41:06.375149+0000","last_fullsized":"2024-04-25T13:41:06.375149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271553+0000","last_change":"2024-04-25T13:41:04.410956+0000","last_active":"2024-04-25T13:41:06.271553+0000","last_peered":"2024-04-25T13:41:06.271553+0000","last_clean":"2024-04-25T13:41:06.271553+0000","last_became_active":"2024-04-25T13:41:04.410665+0000","last_became_peered":"2024-04-25T13:41:04.410665+0000","last_unstale":"2024-04-25T13:41:06.271553+0000","last_undegraded":"2024-04-25T13:41:06.271553+0000","last_fullsized":"2024-04-25T13:41:06.271553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376873+0000","last_change":"2024-04-25T13:41:04.470410+0000","last_active":"2024-04-25T13:41:06.376873+0000","last_peered":"2024-04-25T13:41:06.376873+0000","last_clean":"2024-04-25T13:41:06.376873+0000","last_became_active":"2024-04-25T13:41:04.434676+0000","last_became_peered":"2024-04-25T13:41:04.434676+0000","last_unstale":"2024-04-25T13:41:06.376873+0000","last_undegraded":"2024-04-25T13:41:06.376873+0000","last_fullsized":"2024-04-25T13:41:06.376873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083063+0000","last_change":"2024-04-25T13:41:04.417498+0000","last_active":"2024-04-25T13:41:07.083063+0000","last_peered":"2024-04-25T13:41:07.083063+0000","last_clean":"2024-04-25T13:41:07.083063+0000","last_became_active":"2024-04-25T13:41:04.417145+0000","last_became_peered":"2024-04-25T13:41:04.417145+0000","last_unstale":"2024-04-25T13:41:07.083063+0000","last_undegraded":"2024-04-25T13:41:07.083063+0000","last_fullsized":"2024-04-25T13:41:07.083063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082677+0000","last_change":"2024-04-25T13:41:04.417324+0000","last_active":"2024-04-25T13:41:07.082677+0000","last_peered":"2024-04-25T13:41:07.082677+0000","last_clean":"2024-04-25T13:41:07.082677+0000","last_became_active":"2024-04-25T13:41:04.416982+0000","last_became_peered":"2024-04-25T13:41:04.416982+0000","last_unstale":"2024-04-25T13:41:07.082677+0000","last_undegraded":"2024-04-25T13:41:07.082677+0000","last_fullsized":"2024-04-25T13:41:07.082677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084913+0000","last_change":"2024-04-25T13:41:04.412869+0000","last_active":"2024-04-25T13:41:07.084913+0000","last_peered":"2024-04-25T13:41:07.084913+0000","last_clean":"2024-04-25T13:41:07.084913+0000","last_became_active":"2024-04-25T13:41:04.412544+0000","last_became_peered":"2024-04-25T13:41:04.412544+0000","last_unstale":"2024-04-25T13:41:07.084913+0000","last_undegraded":"2024-04-25T13:41:07.084913+0000","last_fullsized":"2024-04-25T13:41:07.084913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272972+0000","last_change":"2024-04-25T13:41:04.412143+0000","last_active":"2024-04-25T13:41:06.272972+0000","last_peered":"2024-04-25T13:41:06.272972+0000","last_clean":"2024-04-25T13:41:06.272972+0000","last_became_active":"2024-04-25T13:41:04.411840+0000","last_became_peered":"2024-04-25T13:41:04.411840+0000","last_unstale":"2024-04-25T13:41:06.272972+0000","last_undegraded":"2024-04-25T13:41:06.272972+0000","last_fullsized":"2024-04-25T13:41:06.272972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080138+0000","last_change":"2024-04-25T13:41:04.426859+0000","last_active":"2024-04-25T13:41:07.080138+0000","last_peered":"2024-04-25T13:41:07.080138+0000","last_clean":"2024-04-25T13:41:07.080138+0000","last_became_active":"2024-04-25T13:41:04.426437+0000","last_became_peered":"2024-04-25T13:41:04.426437+0000","last_unstale":"2024-04-25T13:41:07.080138+0000","last_undegraded":"2024-04-25T13:41:07.080138+0000","last_fullsized":"2024-04-25T13:41:07.080138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:21.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394006+0000","last_change":"2024-04-25T13:41:04.410712+0000","last_active":"2024-04-25T13:41:05.394006+0000","last_peered":"2024-04-25T13:41:05.394006+0000","last_clean":"2024-04-25T13:41:05.394006+0000","last_became_active":"2024-04-25T13:41:04.410362+0000","last_became_peered":"2024-04-25T13:41:04.410362+0000","last_unstale":"2024-04-25T13:41:05.394006+0000","last_undegraded":"2024-04-25T13:41:05.394006+0000","last_fullsized":"2024-04-25T13:41:05.394006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397254+0000","last_change":"2024-04-25T13:41:04.429493+0000","last_active":"2024-04-25T13:41:05.397254+0000","last_peered":"2024-04-25T13:41:05.397254+0000","last_clean":"2024-04-25T13:41:05.397254+0000","last_became_active":"2024-04-25T13:41:04.429116+0000","last_became_peered":"2024-04-25T13:41:04.429116+0000","last_unstale":"2024-04-25T13:41:05.397254+0000","last_undegraded":"2024-04-25T13:41:05.397254+0000","last_fullsized":"2024-04-25T13:41:05.397254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399835+0000","last_change":"2024-04-25T13:41:04.431688+0000","last_active":"2024-04-25T13:41:05.399835+0000","last_peered":"2024-04-25T13:41:05.399835+0000","last_clean":"2024-04-25T13:41:05.399835+0000","last_became_active":"2024-04-25T13:41:04.431231+0000","last_became_peered":"2024-04-25T13:41:04.431231+0000","last_unstale":"2024-04-25T13:41:05.399835+0000","last_undegraded":"2024-04-25T13:41:05.399835+0000","last_fullsized":"2024-04-25T13:41:05.399835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390359+0000","last_change":"2024-04-25T13:41:04.407914+0000","last_active":"2024-04-25T13:41:05.390359+0000","last_peered":"2024-04-25T13:41:05.390359+0000","last_clean":"2024-04-25T13:41:05.390359+0000","last_became_active":"2024-04-25T13:41:04.407553+0000","last_became_peered":"2024-04-25T13:41:04.407553+0000","last_unstale":"2024-04-25T13:41:05.390359+0000","last_undegraded":"2024-04-25T13:41:05.390359+0000","last_fullsized":"2024-04-25T13:41:05.390359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376272+0000","last_change":"2024-04-25T13:41:04.430301+0000","last_active":"2024-04-25T13:41:06.376272+0000","last_peered":"2024-04-25T13:41:06.376272+0000","last_clean":"2024-04-25T13:41:06.376272+0000","last_became_active":"2024-04-25T13:41:04.428597+0000","last_became_peered":"2024-04-25T13:41:04.428597+0000","last_unstale":"2024-04-25T13:41:06.376272+0000","last_undegraded":"2024-04-25T13:41:06.376272+0000","last_fullsized":"2024-04-25T13:41:06.376272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082158+0000","last_change":"2024-04-25T13:41:04.423772+0000","last_active":"2024-04-25T13:41:07.082158+0000","last_peered":"2024-04-25T13:41:07.082158+0000","last_clean":"2024-04-25T13:41:07.082158+0000","last_became_active":"2024-04-25T13:41:04.423453+0000","last_became_peered":"2024-04-25T13:41:04.423453+0000","last_unstale":"2024-04-25T13:41:07.082158+0000","last_undegraded":"2024-04-25T13:41:07.082158+0000","last_fullsized":"2024-04-25T13:41:07.082158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080752+0000","last_change":"2024-04-25T13:41:04.430195+0000","last_active":"2024-04-25T13:41:07.080752+0000","last_peered":"2024-04-25T13:41:07.080752+0000","last_clean":"2024-04-25T13:41:07.080752+0000","last_became_active":"2024-04-25T13:41:04.429917+0000","last_became_peered":"2024-04-25T13:41:04.429917+0000","last_unstale":"2024-04-25T13:41:07.080752+0000","last_undegraded":"2024-04-25T13:41:07.080752+0000","last_fullsized":"2024-04-25T13:41:07.080752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398046+0000","last_change":"2024-04-25T13:41:04.431579+0000","last_active":"2024-04-25T13:41:05.398046+0000","last_peered":"2024-04-25T13:41:05.398046+0000","last_clean":"2024-04-25T13:41:05.398046+0000","last_became_active":"2024-04-25T13:41:04.431160+0000","last_became_peered":"2024-04-25T13:41:04.431160+0000","last_unstale":"2024-04-25T13:41:05.398046+0000","last_undegraded":"2024-04-25T13:41:05.398046+0000","last_fullsized":"2024-04-25T13:41:05.398046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271836+0000","last_change":"2024-04-25T13:41:04.423185+0000","last_active":"2024-04-25T13:41:06.271836+0000","last_peered":"2024-04-25T13:41:06.271836+0000","last_clean":"2024-04-25T13:41:06.271836+0000","last_became_active":"2024-04-25T13:41:04.422815+0000","last_became_peered":"2024-04-25T13:41:04.422815+0000","last_unstale":"2024-04-25T13:41:06.271836+0000","last_undegraded":"2024-04-25T13:41:06.271836+0000","last_fullsized":"2024-04-25T13:41:06.271836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397647+0000","last_change":"2024-04-25T13:41:04.415522+0000","last_active":"2024-04-25T13:41:05.397647+0000","last_peered":"2024-04-25T13:41:05.397647+0000","last_clean":"2024-04-25T13:41:05.397647+0000","last_became_active":"2024-04-25T13:41:04.414898+0000","last_became_peered":"2024-04-25T13:41:04.414898+0000","last_unstale":"2024-04-25T13:41:05.397647+0000","last_undegraded":"2024-04-25T13:41:05.397647+0000","last_fullsized":"2024-04-25T13:41:05.397647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272770+0000","last_change":"2024-04-25T13:41:04.422142+0000","last_active":"2024-04-25T13:41:06.272770+0000","last_peered":"2024-04-25T13:41:06.272770+0000","last_clean":"2024-04-25T13:41:06.272770+0000","last_became_active":"2024-04-25T13:41:04.421279+0000","last_became_peered":"2024-04-25T13:41:04.421279+0000","last_unstale":"2024-04-25T13:41:06.272770+0000","last_undegraded":"2024-04-25T13:41:06.272770+0000","last_fullsized":"2024-04-25T13:41:06.272770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083116+0000","last_change":"2024-04-25T13:41:04.431595+0000","last_active":"2024-04-25T13:41:07.083116+0000","last_peered":"2024-04-25T13:41:07.083116+0000","last_clean":"2024-04-25T13:41:07.083116+0000","last_became_active":"2024-04-25T13:41:04.431130+0000","last_became_peered":"2024-04-25T13:41:04.431130+0000","last_unstale":"2024-04-25T13:41:07.083116+0000","last_undegraded":"2024-04-25T13:41:07.083116+0000","last_fullsized":"2024-04-25T13:41:07.083116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394417+0000","last_change":"2024-04-25T13:41:04.413732+0000","last_active":"2024-04-25T13:41:05.394417+0000","last_peered":"2024-04-25T13:41:05.394417+0000","last_clean":"2024-04-25T13:41:05.394417+0000","last_became_active":"2024-04-25T13:41:04.413001+0000","last_became_peered":"2024-04-25T13:41:04.413001+0000","last_unstale":"2024-04-25T13:41:05.394417+0000","last_undegraded":"2024-04-25T13:41:05.394417+0000","last_fullsized":"2024-04-25T13:41:05.394417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272664+0000","last_change":"2024-04-25T13:41:04.421963+0000","last_active":"2024-04-25T13:41:06.272664+0000","last_peered":"2024-04-25T13:41:06.272664+0000","last_clean":"2024-04-25T13:41:06.272664+0000","last_became_active":"2024-04-25T13:41:04.421439+0000","last_became_peered":"2024-04-25T13:41:04.421439+0000","last_unstale":"2024-04-25T13:41:06.272664+0000","last_undegraded":"2024-04-25T13:41:06.272664+0000","last_fullsized":"2024-04-25T13:41:06.272664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080989+0000","last_change":"2024-04-25T13:41:04.423204+0000","last_active":"2024-04-25T13:41:07.080989+0000","last_peered":"2024-04-25T13:41:07.080989+0000","last_clean":"2024-04-25T13:41:07.080989+0000","last_became_active":"2024-04-25T13:41:04.422855+0000","last_became_peered":"2024-04-25T13:41:04.422855+0000","last_unstale":"2024-04-25T13:41:07.080989+0000","last_undegraded":"2024-04-25T13:41:07.080989+0000","last_fullsized":"2024-04-25T13:41:07.080989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398240+0000","last_change":"2024-04-25T13:41:04.416506+0000","last_active":"2024-04-25T13:41:05.398240+0000","last_peered":"2024-04-25T13:41:05.398240+0000","last_clean":"2024-04-25T13:41:05.398240+0000","last_became_active":"2024-04-25T13:41:04.416177+0000","last_became_peered":"2024-04-25T13:41:04.416177+0000","last_unstale":"2024-04-25T13:41:05.398240+0000","last_undegraded":"2024-04-25T13:41:05.398240+0000","last_fullsized":"2024-04-25T13:41:05.398240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390077+0000","last_change":"2024-04-25T13:41:04.414817+0000","last_active":"2024-04-25T13:41:05.390077+0000","last_peered":"2024-04-25T13:41:05.390077+0000","last_clean":"2024-04-25T13:41:05.390077+0000","last_became_active":"2024-04-25T13:41:04.414178+0000","last_became_peered":"2024-04-25T13:41:04.414178+0000","last_unstale":"2024-04-25T13:41:05.390077+0000","last_undegraded":"2024-04-25T13:41:05.390077+0000","last_fullsized":"2024-04-25T13:41:05.390077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081720+0000","last_change":"2024-04-25T13:41:04.430078+0000","last_active":"2024-04-25T13:41:07.081720+0000","last_peered":"2024-04-25T13:41:07.081720+0000","last_clean":"2024-04-25T13:41:07.081720+0000","last_became_active":"2024-04-25T13:41:04.429518+0000","last_became_peered":"2024-04-25T13:41:04.429518+0000","last_unstale":"2024-04-25T13:41:07.081720+0000","last_undegraded":"2024-04-25T13:41:07.081720+0000","last_fullsized":"2024-04-25T13:41:07.081720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084010+0000","last_change":"2024-04-25T13:41:04.402158+0000","last_active":"2024-04-25T13:41:07.084010+0000","last_peered":"2024-04-25T13:41:07.084010+0000","last_clean":"2024-04-25T13:41:07.084010+0000","last_became_active":"2024-04-25T13:41:04.401821+0000","last_became_peered":"2024-04-25T13:41:04.401821+0000","last_unstale":"2024-04-25T13:41:07.084010+0000","last_undegraded":"2024-04-25T13:41:07.084010+0000","last_fullsized":"2024-04-25T13:41:07.084010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:18.457935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272477+0000","last_change":"2024-04-25T13:41:03.425690+0000","last_active":"2024-04-25T13:41:06.272477+0000","last_peered":"2024-04-25T13:41:06.272477+0000","last_clean":"2024-04-25T13:41:06.272477+0000","last_became_active":"2024-04-25T13:41:03.425239+0000","last_became_peered":"2024-04-25T13:41:03.425239+0000","last_unstale":"2024-04-25T13:41:06.272477+0000","last_undegraded":"2024-04-25T13:41:06.272477+0000","last_fullsized":"2024-04-25T13:41:06.272477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081045+0000","last_change":"2024-04-25T13:41:04.411250+0000","last_active":"2024-04-25T13:41:07.081045+0000","last_peered":"2024-04-25T13:41:07.081045+0000","last_clean":"2024-04-25T13:41:07.081045+0000","last_became_active":"2024-04-25T13:41:04.400223+0000","last_became_peered":"2024-04-25T13:41:04.400223+0000","last_unstale":"2024-04-25T13:41:07.081045+0000","last_undegraded":"2024-04-25T13:41:07.081045+0000","last_fullsized":"2024-04-25T13:41:07.081045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081971+0000","last_change":"2024-04-25T13:41:03.435467+0000","last_active":"2024-04-25T13:41:07.081971+0000","last_peered":"2024-04-25T13:41:07.081971+0000","last_clean":"2024-04-25T13:41:07.081971+0000","last_became_active":"2024-04-25T13:41:03.426677+0000","last_became_peered":"2024-04-25T13:41:03.426677+0000","last_unstale":"2024-04-25T13:41:07.081971+0000","last_undegraded":"2024-04-25T13:41:07.081971+0000","last_fullsized":"2024-04-25T13:41:07.081971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271566+0000","last_change":"2024-04-25T13:41:03.437180+0000","last_active":"2024-04-25T13:41:06.271566+0000","last_peered":"2024-04-25T13:41:06.271566+0000","last_clean":"2024-04-25T13:41:06.271566+0000","last_became_active":"2024-04-25T13:41:03.436905+0000","last_became_peered":"2024-04-25T13:41:03.436905+0000","last_unstale":"2024-04-25T13:41:06.271566+0000","last_undegraded":"2024-04-25T13:41:06.271566+0000","last_fullsized":"2024-04-25T13:41:06.271566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271768+0000","last_change":"2024-04-25T13:41:04.423777+0000","last_active":"2024-04-25T13:41:06.271768+0000","last_peered":"2024-04-25T13:41:06.271768+0000","last_clean":"2024-04-25T13:41:06.271768+0000","last_became_active":"2024-04-25T13:41:04.423470+0000","last_became_peered":"2024-04-25T13:41:04.423470+0000","last_unstale":"2024-04-25T13:41:06.271768+0000","last_undegraded":"2024-04-25T13:41:06.271768+0000","last_fullsized":"2024-04-25T13:41:06.271768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397437+0000","last_change":"2024-04-25T13:41:03.445205+0000","last_active":"2024-04-25T13:41:05.397437+0000","last_peered":"2024-04-25T13:41:05.397437+0000","last_clean":"2024-04-25T13:41:05.397437+0000","last_became_active":"2024-04-25T13:41:03.444412+0000","last_became_peered":"2024-04-25T13:41:03.444412+0000","last_unstale":"2024-04-25T13:41:05.397437+0000","last_undegraded":"2024-04-25T13:41:05.397437+0000","last_fullsized":"2024-04-25T13:41:05.397437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.393826+0000","last_change":"2024-04-25T13:41:04.413827+0000","last_active":"2024-04-25T13:41:05.393826+0000","last_peered":"2024-04-25T13:41:05.393826+0000","last_clean":"2024-04-25T13:41:05.393826+0000","last_became_active":"2024-04-25T13:41:04.413496+0000","last_became_peered":"2024-04-25T13:41:04.413496+0000","last_unstale":"2024-04-25T13:41:05.393826+0000","last_undegraded":"2024-04-25T13:41:05.393826+0000","last_fullsized":"2024-04-25T13:41:05.393826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082917+0000","last_change":"2024-04-25T13:41:03.450428+0000","last_active":"2024-04-25T13:41:07.082917+0000","last_peered":"2024-04-25T13:41:07.082917+0000","last_clean":"2024-04-25T13:41:07.082917+0000","last_became_active":"2024-04-25T13:41:03.449629+0000","last_became_peered":"2024-04-25T13:41:03.449629+0000","last_unstale":"2024-04-25T13:41:07.082917+0000","last_undegraded":"2024-04-25T13:41:07.082917+0000","last_fullsized":"2024-04-25T13:41:07.082917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399527+0000","last_change":"2024-04-25T13:41:04.431979+0000","last_active":"2024-04-25T13:41:05.399527+0000","last_peered":"2024-04-25T13:41:05.399527+0000","last_clean":"2024-04-25T13:41:05.399527+0000","last_became_active":"2024-04-25T13:41:04.431218+0000","last_became_peered":"2024-04-25T13:41:04.431218+0000","last_unstale":"2024-04-25T13:41:05.399527+0000","last_undegraded":"2024-04-25T13:41:05.399527+0000","last_fullsized":"2024-04-25T13:41:05.399527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399630+0000","last_change":"2024-04-25T13:41:03.445209+0000","last_active":"2024-04-25T13:41:05.399630+0000","last_peered":"2024-04-25T13:41:05.399630+0000","last_clean":"2024-04-25T13:41:05.399630+0000","last_became_active":"2024-04-25T13:41:03.444460+0000","last_became_peered":"2024-04-25T13:41:03.444460+0000","last_unstale":"2024-04-25T13:41:05.399630+0000","last_undegraded":"2024-04-25T13:41:05.399630+0000","last_fullsized":"2024-04-25T13:41:05.399630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080960+0000","last_change":"2024-04-25T13:41:04.423661+0000","last_active":"2024-04-25T13:41:07.080960+0000","last_peered":"2024-04-25T13:41:07.080960+0000","last_clean":"2024-04-25T13:41:07.080960+0000","last_became_active":"2024-04-25T13:41:04.421991+0000","last_became_peered":"2024-04-25T13:41:04.421991+0000","last_unstale":"2024-04-25T13:41:07.080960+0000","last_undegraded":"2024-04-25T13:41:07.080960+0000","last_fullsized":"2024-04-25T13:41:07.080960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394142+0000","last_change":"2024-04-25T13:41:03.443960+0000","last_active":"2024-04-25T13:41:05.394142+0000","last_peered":"2024-04-25T13:41:05.394142+0000","last_clean":"2024-04-25T13:41:05.394142+0000","last_became_active":"2024-04-25T13:41:03.443721+0000","last_became_peered":"2024-04-25T13:41:03.443721+0000","last_unstale":"2024-04-25T13:41:05.394142+0000","last_undegraded":"2024-04-25T13:41:05.394142+0000","last_fullsized":"2024-04-25T13:41:05.394142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.085160+0000","last_change":"2024-04-25T13:41:04.423896+0000","last_active":"2024-04-25T13:41:07.085160+0000","last_peered":"2024-04-25T13:41:07.085160+0000","last_clean":"2024-04-25T13:41:07.085160+0000","last_became_active":"2024-04-25T13:41:04.423569+0000","last_became_peered":"2024-04-25T13:41:04.423569+0000","last_unstale":"2024-04-25T13:41:07.085160+0000","last_undegraded":"2024-04-25T13:41:07.085160+0000","last_fullsized":"2024-04-25T13:41:07.085160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081924+0000","last_change":"2024-04-25T13:41:03.426055+0000","last_active":"2024-04-25T13:41:07.081924+0000","last_peered":"2024-04-25T13:41:07.081924+0000","last_clean":"2024-04-25T13:41:07.081924+0000","last_became_active":"2024-04-25T13:41:03.424990+0000","last_became_peered":"2024-04-25T13:41:03.424990+0000","last_unstale":"2024-04-25T13:41:07.081924+0000","last_undegraded":"2024-04-25T13:41:07.081924+0000","last_fullsized":"2024-04-25T13:41:07.081924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375890+0000","last_change":"2024-04-25T13:41:04.430564+0000","last_active":"2024-04-25T13:41:06.375890+0000","last_peered":"2024-04-25T13:41:06.375890+0000","last_clean":"2024-04-25T13:41:06.375890+0000","last_became_active":"2024-04-25T13:41:04.427802+0000","last_became_peered":"2024-04-25T13:41:04.427802+0000","last_unstale":"2024-04-25T13:41:06.375890+0000","last_undegraded":"2024-04-25T13:41:06.375890+0000","last_fullsized":"2024-04-25T13:41:06.375890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081161+0000","last_change":"2024-04-25T13:41:03.422851+0000","last_active":"2024-04-25T13:41:07.081161+0000","last_peered":"2024-04-25T13:41:07.081161+0000","last_clean":"2024-04-25T13:41:07.081161+0000","last_became_active":"2024-04-25T13:41:03.422529+0000","last_became_peered":"2024-04-25T13:41:03.422529+0000","last_unstale":"2024-04-25T13:41:07.081161+0000","last_undegraded":"2024-04-25T13:41:07.081161+0000","last_fullsized":"2024-04-25T13:41:07.081161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080588+0000","last_change":"2024-04-25T13:41:04.429077+0000","last_active":"2024-04-25T13:41:07.080588+0000","last_peered":"2024-04-25T13:41:07.080588+0000","last_clean":"2024-04-25T13:41:07.080588+0000","last_became_active":"2024-04-25T13:41:04.428641+0000","last_became_peered":"2024-04-25T13:41:04.428641+0000","last_unstale":"2024-04-25T13:41:07.080588+0000","last_undegraded":"2024-04-25T13:41:07.080588+0000","last_fullsized":"2024-04-25T13:41:07.080588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398137+0000","last_change":"2024-04-25T13:41:03.450649+0000","last_active":"2024-04-25T13:41:05.398137+0000","last_peered":"2024-04-25T13:41:05.398137+0000","last_clean":"2024-04-25T13:41:05.398137+0000","last_became_active":"2024-04-25T13:41:03.449872+0000","last_became_peered":"2024-04-25T13:41:03.449872+0000","last_unstale":"2024-04-25T13:41:05.398137+0000","last_undegraded":"2024-04-25T13:41:05.398137+0000","last_fullsized":"2024-04-25T13:41:05.398137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375589+0000","last_change":"2024-04-25T13:41:04.434947+0000","last_active":"2024-04-25T13:41:06.375589+0000","last_peered":"2024-04-25T13:41:06.375589+0000","last_clean":"2024-04-25T13:41:06.375589+0000","last_became_active":"2024-04-25T13:41:04.434502+0000","last_became_peered":"2024-04-25T13:41:04.434502+0000","last_unstale":"2024-04-25T13:41:06.375589+0000","last_undegraded":"2024-04-25T13:41:06.375589+0000","last_fullsized":"2024-04-25T13:41:06.375589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081461+0000","last_change":"2024-04-25T13:41:03.423826+0000","last_active":"2024-04-25T13:41:07.081461+0000","last_peered":"2024-04-25T13:41:07.081461+0000","last_clean":"2024-04-25T13:41:07.081461+0000","last_became_active":"2024-04-25T13:41:03.423037+0000","last_became_peered":"2024-04-25T13:41:03.423037+0000","last_unstale":"2024-04-25T13:41:07.081461+0000","last_undegraded":"2024-04-25T13:41:07.081461+0000","last_fullsized":"2024-04-25T13:41:07.081461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081702+0000","last_change":"2024-04-25T13:41:04.429831+0000","last_active":"2024-04-25T13:41:07.081702+0000","last_peered":"2024-04-25T13:41:07.081702+0000","last_clean":"2024-04-25T13:41:07.081702+0000","last_became_active":"2024-04-25T13:41:04.429110+0000","last_became_peered":"2024-04-25T13:41:04.429110+0000","last_unstale":"2024-04-25T13:41:07.081702+0000","last_undegraded":"2024-04-25T13:41:07.081702+0000","last_fullsized":"2024-04-25T13:41:07.081702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.389771+0000","last_change":"2024-04-25T13:41:03.409148+0000","last_active":"2024-04-25T13:41:05.389771+0000","last_peered":"2024-04-25T13:41:05.389771+0000","last_clean":"2024-04-25T13:41:05.389771+0000","last_became_active":"2024-04-25T13:41:03.408414+0000","last_became_peered":"2024-04-25T13:41:03.408414+0000","last_unstale":"2024-04-25T13:41:05.389771+0000","last_undegraded":"2024-04-25T13:41:05.389771+0000","last_fullsized":"2024-04-25T13:41:05.389771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375388+0000","last_change":"2024-04-25T13:41:04.426477+0000","last_active":"2024-04-25T13:41:06.375388+0000","last_peered":"2024-04-25T13:41:06.375388+0000","last_clean":"2024-04-25T13:41:06.375388+0000","last_became_active":"2024-04-25T13:41:04.425891+0000","last_became_peered":"2024-04-25T13:41:04.425891+0000","last_unstale":"2024-04-25T13:41:06.375388+0000","last_undegraded":"2024-04-25T13:41:06.375388+0000","last_fullsized":"2024-04-25T13:41:06.375388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084806+0000","last_change":"2024-04-25T13:41:03.421716+0000","last_active":"2024-04-25T13:41:07.084806+0000","last_peered":"2024-04-25T13:41:07.084806+0000","last_clean":"2024-04-25T13:41:07.084806+0000","last_became_active":"2024-04-25T13:41:03.420848+0000","last_became_peered":"2024-04-25T13:41:03.420848+0000","last_unstale":"2024-04-25T13:41:07.084806+0000","last_undegraded":"2024-04-25T13:41:07.084806+0000","last_fullsized":"2024-04-25T13:41:07.084806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.389116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376433+0000","last_change":"2024-04-25T13:41:04.429840+0000","last_active":"2024-04-25T13:41:06.376433+0000","last_peered":"2024-04-25T13:41:06.376433+0000","last_clean":"2024-04-25T13:41:06.376433+0000","last_became_active":"2024-04-25T13:41:04.429404+0000","last_became_peered":"2024-04-25T13:41:04.429404+0000","last_unstale":"2024-04-25T13:41:06.376433+0000","last_undegraded":"2024-04-25T13:41:06.376433+0000","last_fullsized":"2024-04-25T13:41:06.376433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390507+0000","last_change":"2024-04-25T13:41:03.415723+0000","last_active":"2024-04-25T13:41:05.390507+0000","last_peered":"2024-04-25T13:41:05.390507+0000","last_clean":"2024-04-25T13:41:05.390507+0000","last_became_active":"2024-04-25T13:41:03.414957+0000","last_became_peered":"2024-04-25T13:41:03.414957+0000","last_unstale":"2024-04-25T13:41:05.390507+0000","last_undegraded":"2024-04-25T13:41:05.390507+0000","last_fullsized":"2024-04-25T13:41:05.390507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376788+0000","last_change":"2024-04-25T13:41:04.434675+0000","last_active":"2024-04-25T13:41:06.376788+0000","last_peered":"2024-04-25T13:41:06.376788+0000","last_clean":"2024-04-25T13:41:06.376788+0000","last_became_active":"2024-04-25T13:41:04.434194+0000","last_became_peered":"2024-04-25T13:41:04.434194+0000","last_unstale":"2024-04-25T13:41:06.376788+0000","last_undegraded":"2024-04-25T13:41:06.376788+0000","last_fullsized":"2024-04-25T13:41:06.376788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394277+0000","last_change":"2024-04-25T13:41:03.402131+0000","last_active":"2024-04-25T13:41:05.394277+0000","last_peered":"2024-04-25T13:41:05.394277+0000","last_clean":"2024-04-25T13:41:05.394277+0000","last_became_active":"2024-04-25T13:41:03.401398+0000","last_became_peered":"2024-04-25T13:41:03.401398+0000","last_unstale":"2024-04-25T13:41:05.394277+0000","last_undegraded":"2024-04-25T13:41:05.394277+0000","last_fullsized":"2024-04-25T13:41:05.394277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398944+0000","last_change":"2024-04-25T13:41:04.418743+0000","last_active":"2024-04-25T13:41:05.398944+0000","last_peered":"2024-04-25T13:41:05.398944+0000","last_clean":"2024-04-25T13:41:05.398944+0000","last_became_active":"2024-04-25T13:41:04.417963+0000","last_became_peered":"2024-04-25T13:41:04.417963+0000","last_unstale":"2024-04-25T13:41:05.398944+0000","last_undegraded":"2024-04-25T13:41:05.398944+0000","last_fullsized":"2024-04-25T13:41:05.398944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390275+0000","last_change":"2024-04-25T13:41:03.445729+0000","last_active":"2024-04-25T13:41:05.390275+0000","last_peered":"2024-04-25T13:41:05.390275+0000","last_clean":"2024-04-25T13:41:05.390275+0000","last_became_active":"2024-04-25T13:41:03.445293+0000","last_became_peered":"2024-04-25T13:41:03.445293+0000","last_unstale":"2024-04-25T13:41:05.390275+0000","last_undegraded":"2024-04-25T13:41:05.390275+0000","last_fullsized":"2024-04-25T13:41:05.390275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375956+0000","last_change":"2024-04-25T13:41:04.429996+0000","last_active":"2024-04-25T13:41:06.375956+0000","last_peered":"2024-04-25T13:41:06.375956+0000","last_clean":"2024-04-25T13:41:06.375956+0000","last_became_active":"2024-04-25T13:41:04.428232+0000","last_became_peered":"2024-04-25T13:41:04.428232+0000","last_unstale":"2024-04-25T13:41:06.375956+0000","last_undegraded":"2024-04-25T13:41:06.375956+0000","last_fullsized":"2024-04-25T13:41:06.375956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375088+0000","last_change":"2024-04-25T13:41:00.175142+0000","last_active":"2024-04-25T13:41:06.375088+0000","last_peered":"2024-04-25T13:41:06.375088+0000","last_clean":"2024-04-25T13:41:06.375088+0000","last_became_active":"2024-04-25T13:41:00.172906+0000","last_became_peered":"2024-04-25T13:41:00.172906+0000","last_unstale":"2024-04-25T13:41:06.375088+0000","last_undegraded":"2024-04-25T13:41:06.375088+0000","last_fullsized":"2024-04-25T13:41:06.375088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_clean_scrub_stamp":"2024-04-25T13:40:59.093070+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:38.020124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397151+0000","last_change":"2024-04-25T13:41:03.438420+0000","last_active":"2024-04-25T13:41:05.397151+0000","last_peered":"2024-04-25T13:41:05.397151+0000","last_clean":"2024-04-25T13:41:05.397151+0000","last_became_active":"2024-04-25T13:41:03.437569+0000","last_became_peered":"2024-04-25T13:41:03.437569+0000","last_unstale":"2024-04-25T13:41:05.397151+0000","last_undegraded":"2024-04-25T13:41:05.397151+0000","last_fullsized":"2024-04-25T13:41:05.397151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272317+0000","last_change":"2024-04-25T13:41:04.417328+0000","last_active":"2024-04-25T13:41:06.272317+0000","last_peered":"2024-04-25T13:41:06.272317+0000","last_clean":"2024-04-25T13:41:06.272317+0000","last_became_active":"2024-04-25T13:41:04.416666+0000","last_became_peered":"2024-04-25T13:41:04.416666+0000","last_unstale":"2024-04-25T13:41:06.272317+0000","last_undegraded":"2024-04-25T13:41:06.272317+0000","last_fullsized":"2024-04-25T13:41:06.272317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.374736+0000","last_change":"2024-04-25T13:41:03.431855+0000","last_active":"2024-04-25T13:41:06.374736+0000","last_peered":"2024-04-25T13:41:06.374736+0000","last_clean":"2024-04-25T13:41:06.374736+0000","last_became_active":"2024-04-25T13:41:03.429200+0000","last_became_peered":"2024-04-25T13:41:03.429200+0000","last_unstale":"2024-04-25T13:41:06.374736+0000","last_undegraded":"2024-04-25T13:41:06.374736+0000","last_fullsized":"2024-04-25T13:41:06.374736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080267+0000","last_change":"2024-04-25T13:41:04.411548+0000","last_active":"2024-04-25T13:41:07.080267+0000","last_peered":"2024-04-25T13:41:07.080267+0000","last_clean":"2024-04-25T13:41:07.080267+0000","last_became_active":"2024-04-25T13:41:04.400093+0000","last_became_peered":"2024-04-25T13:41:04.400093+0000","last_unstale":"2024-04-25T13:41:07.080267+0000","last_undegraded":"2024-04-25T13:41:07.080267+0000","last_fullsized":"2024-04-25T13:41:07.080267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:09.999429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390174+0000","last_change":"2024-04-25T13:41:03.415949+0000","last_active":"2024-04-25T13:41:05.390174+0000","last_peered":"2024-04-25T13:41:05.390174+0000","last_clean":"2024-04-25T13:41:05.390174+0000","last_became_active":"2024-04-25T13:41:03.414899+0000","last_became_peered":"2024-04-25T13:41:03.414899+0000","last_unstale":"2024-04-25T13:41:05.390174+0000","last_undegraded":"2024-04-25T13:41:05.390174+0000","last_fullsized":"2024-04-25T13:41:05.390174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394211+0000","last_change":"2024-04-25T13:41:04.403032+0000","last_active":"2024-04-25T13:41:05.394211+0000","last_peered":"2024-04-25T13:41:05.394211+0000","last_clean":"2024-04-25T13:41:05.394211+0000","last_became_active":"2024-04-25T13:41:04.402055+0000","last_became_peered":"2024-04-25T13:41:04.402055+0000","last_unstale":"2024-04-25T13:41:05.394211+0000","last_undegraded":"2024-04-25T13:41:05.394211+0000","last_fullsized":"2024-04-25T13:41:05.394211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398292+0000","last_change":"2024-04-25T13:41:03.447547+0000","last_active":"2024-04-25T13:41:05.398292+0000","last_peered":"2024-04-25T13:41:05.398292+0000","last_clean":"2024-04-25T13:41:05.398292+0000","last_became_active":"2024-04-25T13:41:03.444429+0000","last_became_peered":"2024-04-25T13:41:03.444429+0000","last_unstale":"2024-04-25T13:41:05.398292+0000","last_undegraded":"2024-04-25T13:41:05.398292+0000","last_fullsized":"2024-04-25T13:41:05.398292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084597+0000","last_change":"2024-04-25T13:41:04.398647+0000","last_active":"2024-04-25T13:41:07.084597+0000","last_peered":"2024-04-25T13:41:07.084597+0000","last_clean":"2024-04-25T13:41:07.084597+0000","last_became_active":"2024-04-25T13:41:04.398287+0000","last_became_peered":"2024-04-25T13:41:04.398287+0000","last_unstale":"2024-04-25T13:41:07.084597+0000","last_undegraded":"2024-04-25T13:41:07.084597+0000","last_fullsized":"2024-04-25T13:41:07.084597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:06.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394703+0000","last_change":"2024-04-25T13:41:03.414535+0000","last_active":"2024-04-25T13:41:05.394703+0000","last_peered":"2024-04-25T13:41:05.394703+0000","last_clean":"2024-04-25T13:41:05.394703+0000","last_became_active":"2024-04-25T13:41:03.414145+0000","last_became_peered":"2024-04-25T13:41:03.414145+0000","last_unstale":"2024-04-25T13:41:05.394703+0000","last_undegraded":"2024-04-25T13:41:05.394703+0000","last_fullsized":"2024-04-25T13:41:05.394703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399648+0000","last_change":"2024-04-25T13:41:04.419186+0000","last_active":"2024-04-25T13:41:05.399648+0000","last_peered":"2024-04-25T13:41:05.399648+0000","last_clean":"2024-04-25T13:41:05.399648+0000","last_became_active":"2024-04-25T13:41:04.417831+0000","last_became_peered":"2024-04-25T13:41:04.417831+0000","last_unstale":"2024-04-25T13:41:05.399648+0000","last_undegraded":"2024-04-25T13:41:05.399648+0000","last_fullsized":"2024-04-25T13:41:05.399648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376400+0000","last_change":"2024-04-25T13:41:03.424206+0000","last_active":"2024-04-25T13:41:06.376400+0000","last_peered":"2024-04-25T13:41:06.376400+0000","last_clean":"2024-04-25T13:41:06.376400+0000","last_became_active":"2024-04-25T13:41:03.423176+0000","last_became_peered":"2024-04-25T13:41:03.423176+0000","last_unstale":"2024-04-25T13:41:06.376400+0000","last_undegraded":"2024-04-25T13:41:06.376400+0000","last_fullsized":"2024-04-25T13:41:06.376400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:23.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394828+0000","last_change":"2024-04-25T13:41:04.402353+0000","last_active":"2024-04-25T13:41:05.394828+0000","last_peered":"2024-04-25T13:41:05.394828+0000","last_clean":"2024-04-25T13:41:05.394828+0000","last_became_active":"2024-04-25T13:41:04.402014+0000","last_became_peered":"2024-04-25T13:41:04.402014+0000","last_unstale":"2024-04-25T13:41:05.394828+0000","last_undegraded":"2024-04-25T13:41:05.394828+0000","last_fullsized":"2024-04-25T13:41:05.394828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394770+0000","last_change":"2024-04-25T13:41:03.439449+0000","last_active":"2024-04-25T13:41:05.394770+0000","last_peered":"2024-04-25T13:41:05.394770+0000","last_clean":"2024-04-25T13:41:05.394770+0000","last_became_active":"2024-04-25T13:41:03.439074+0000","last_became_peered":"2024-04-25T13:41:03.439074+0000","last_unstale":"2024-04-25T13:41:05.394770+0000","last_undegraded":"2024-04-25T13:41:05.394770+0000","last_fullsized":"2024-04-25T13:41:05.394770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272770+0000","last_change":"2024-04-25T13:41:04.418630+0000","last_active":"2024-04-25T13:41:06.272770+0000","last_peered":"2024-04-25T13:41:06.272770+0000","last_clean":"2024-04-25T13:41:06.272770+0000","last_became_active":"2024-04-25T13:41:04.418330+0000","last_became_peered":"2024-04-25T13:41:04.418330+0000","last_unstale":"2024-04-25T13:41:06.272770+0000","last_undegraded":"2024-04-25T13:41:06.272770+0000","last_fullsized":"2024-04-25T13:41:06.272770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083247+0000","last_change":"2024-04-25T13:41:03.435851+0000","last_active":"2024-04-25T13:41:07.083247+0000","last_peered":"2024-04-25T13:41:07.083247+0000","last_clean":"2024-04-25T13:41:07.083247+0000","last_became_active":"2024-04-25T13:41:03.434870+0000","last_became_peered":"2024-04-25T13:41:03.434870+0000","last_unstale":"2024-04-25T13:41:07.083247+0000","last_undegraded":"2024-04-25T13:41:07.083247+0000","last_fullsized":"2024-04-25T13:41:07.083247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080993+0000","last_change":"2024-04-25T13:41:04.426962+0000","last_active":"2024-04-25T13:41:07.080993+0000","last_peered":"2024-04-25T13:41:07.080993+0000","last_clean":"2024-04-25T13:41:07.080993+0000","last_became_active":"2024-04-25T13:41:04.426424+0000","last_became_peered":"2024-04-25T13:41:04.426424+0000","last_unstale":"2024-04-25T13:41:07.080993+0000","last_undegraded":"2024-04-25T13:41:07.080993+0000","last_fullsized":"2024-04-25T13:41:07.080993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.374720+0000","last_change":"2024-04-25T13:41:03.430095+0000","last_active":"2024-04-25T13:41:06.374720+0000","last_peered":"2024-04-25T13:41:06.374720+0000","last_clean":"2024-04-25T13:41:06.374720+0000","last_became_active":"2024-04-25T13:41:03.429094+0000","last_became_peered":"2024-04-25T13:41:03.429094+0000","last_unstale":"2024-04-25T13:41:06.374720+0000","last_undegraded":"2024-04-25T13:41:06.374720+0000","last_fullsized":"2024-04-25T13:41:06.374720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083934+0000","last_change":"2024-04-25T13:41:04.413097+0000","last_active":"2024-04-25T13:41:07.083934+0000","last_peered":"2024-04-25T13:41:07.083934+0000","last_clean":"2024-04-25T13:41:07.083934+0000","last_became_active":"2024-04-25T13:41:04.412572+0000","last_became_peered":"2024-04-25T13:41:04.412572+0000","last_unstale":"2024-04-25T13:41:07.083934+0000","last_undegraded":"2024-04-25T13:41:07.083934+0000","last_fullsized":"2024-04-25T13:41:07.083934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:50.740570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394078+0000","last_change":"2024-04-25T13:41:03.411890+0000","last_active":"2024-04-25T13:41:05.394078+0000","last_peered":"2024-04-25T13:41:05.394078+0000","last_clean":"2024-04-25T13:41:05.394078+0000","last_became_active":"2024-04-25T13:41:03.411481+0000","last_became_peered":"2024-04-25T13:41:03.411481+0000","last_unstale":"2024-04-25T13:41:05.394078+0000","last_undegraded":"2024-04-25T13:41:05.394078+0000","last_fullsized":"2024-04-25T13:41:05.394078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272095+0000","last_change":"2024-04-25T13:41:04.408896+0000","last_active":"2024-04-25T13:41:06.272095+0000","last_peered":"2024-04-25T13:41:06.272095+0000","last_clean":"2024-04-25T13:41:06.272095+0000","last_became_active":"2024-04-25T13:41:04.408517+0000","last_became_peered":"2024-04-25T13:41:04.408517+0000","last_unstale":"2024-04-25T13:41:06.272095+0000","last_undegraded":"2024-04-25T13:41:06.272095+0000","last_fullsized":"2024-04-25T13:41:06.272095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394550+0000","last_change":"2024-04-25T13:41:03.408129+0000","last_active":"2024-04-25T13:41:05.394550+0000","last_peered":"2024-04-25T13:41:05.394550+0000","last_clean":"2024-04-25T13:41:05.394550+0000","last_became_active":"2024-04-25T13:41:03.407713+0000","last_became_peered":"2024-04-25T13:41:03.407713+0000","last_unstale":"2024-04-25T13:41:05.394550+0000","last_undegraded":"2024-04-25T13:41:05.394550+0000","last_fullsized":"2024-04-25T13:41:05.394550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272097+0000","last_change":"2024-04-25T13:41:04.424601+0000","last_active":"2024-04-25T13:41:06.272097+0000","last_peered":"2024-04-25T13:41:06.272097+0000","last_clean":"2024-04-25T13:41:06.272097+0000","last_became_active":"2024-04-25T13:41:04.424153+0000","last_became_peered":"2024-04-25T13:41:04.424153+0000","last_unstale":"2024-04-25T13:41:06.272097+0000","last_undegraded":"2024-04-25T13:41:06.272097+0000","last_fullsized":"2024-04-25T13:41:06.272097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375586+0000","last_change":"2024-04-25T13:41:03.431525+0000","last_active":"2024-04-25T13:41:06.375586+0000","last_peered":"2024-04-25T13:41:06.375586+0000","last_clean":"2024-04-25T13:41:06.375586+0000","last_became_active":"2024-04-25T13:41:03.430716+0000","last_became_peered":"2024-04-25T13:41:03.430716+0000","last_unstale":"2024-04-25T13:41:06.375586+0000","last_undegraded":"2024-04-25T13:41:06.375586+0000","last_fullsized":"2024-04-25T13:41:06.375586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:46.480379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081813+0000","last_change":"2024-04-25T13:41:04.424614+0000","last_active":"2024-04-25T13:41:07.081813+0000","last_peered":"2024-04-25T13:41:07.081813+0000","last_clean":"2024-04-25T13:41:07.081813+0000","last_became_active":"2024-04-25T13:41:04.424248+0000","last_became_peered":"2024-04-25T13:41:04.424248+0000","last_unstale":"2024-04-25T13:41:07.081813+0000","last_undegraded":"2024-04-25T13:41:07.081813+0000","last_fullsized":"2024-04-25T13:41:07.081813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399200+0000","last_change":"2024-04-25T13:41:04.425893+0000","last_active":"2024-04-25T13:41:05.399200+0000","last_peered":"2024-04-25T13:41:05.399200+0000","last_clean":"2024-04-25T13:41:05.399200+0000","last_became_active":"2024-04-25T13:41:04.424475+0000","last_became_peered":"2024-04-25T13:41:04.424475+0000","last_unstale":"2024-04-25T13:41:05.399200+0000","last_undegraded":"2024-04-25T13:41:05.399200+0000","last_fullsized":"2024-04-25T13:41:05.399200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375539+0000","last_change":"2024-04-25T13:41:03.447296+0000","last_active":"2024-04-25T13:41:06.375539+0000","last_peered":"2024-04-25T13:41:06.375539+0000","last_clean":"2024-04-25T13:41:06.375539+0000","last_became_active":"2024-04-25T13:41:03.446522+0000","last_became_peered":"2024-04-25T13:41:03.446522+0000","last_unstale":"2024-04-25T13:41:06.375539+0000","last_undegraded":"2024-04-25T13:41:06.375539+0000","last_fullsized":"2024-04-25T13:41:06.375539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398474+0000","last_change":"2024-04-25T13:41:04.424211+0000","last_active":"2024-04-25T13:41:05.398474+0000","last_peered":"2024-04-25T13:41:05.398474+0000","last_clean":"2024-04-25T13:41:05.398474+0000","last_became_active":"2024-04-25T13:41:04.423899+0000","last_became_peered":"2024-04-25T13:41:04.423899+0000","last_unstale":"2024-04-25T13:41:05.398474+0000","last_undegraded":"2024-04-25T13:41:05.398474+0000","last_fullsized":"2024-04-25T13:41:05.398474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376048+0000","last_change":"2024-04-25T13:41:03.441717+0000","last_active":"2024-04-25T13:41:06.376048+0000","last_peered":"2024-04-25T13:41:06.376048+0000","last_clean":"2024-04-25T13:41:06.376048+0000","last_became_active":"2024-04-25T13:41:03.440886+0000","last_became_peered":"2024-04-25T13:41:03.440886+0000","last_unstale":"2024-04-25T13:41:06.376048+0000","last_undegraded":"2024-04-25T13:41:06.376048+0000","last_fullsized":"2024-04-25T13:41:06.376048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081156+0000","last_change":"2024-04-25T13:41:04.423577+0000","last_active":"2024-04-25T13:41:07.081156+0000","last_peered":"2024-04-25T13:41:07.081156+0000","last_clean":"2024-04-25T13:41:07.081156+0000","last_became_active":"2024-04-25T13:41:04.422496+0000","last_became_peered":"2024-04-25T13:41:04.422496+0000","last_unstale":"2024-04-25T13:41:07.081156+0000","last_undegraded":"2024-04-25T13:41:07.081156+0000","last_fullsized":"2024-04-25T13:41:07.081156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272735+0000","last_change":"2024-04-25T13:41:03.418067+0000","last_active":"2024-04-25T13:41:06.272735+0000","last_peered":"2024-04-25T13:41:06.272735+0000","last_clean":"2024-04-25T13:41:06.272735+0000","last_became_active":"2024-04-25T13:41:03.417592+0000","last_became_peered":"2024-04-25T13:41:03.417592+0000","last_unstale":"2024-04-25T13:41:06.272735+0000","last_undegraded":"2024-04-25T13:41:06.272735+0000","last_fullsized":"2024-04-25T13:41:06.272735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272712+0000","last_change":"2024-04-25T13:41:04.410387+0000","last_active":"2024-04-25T13:41:06.272712+0000","last_peered":"2024-04-25T13:41:06.272712+0000","last_clean":"2024-04-25T13:41:06.272712+0000","last_became_active":"2024-04-25T13:41:04.410065+0000","last_became_peered":"2024-04-25T13:41:04.410065+0000","last_unstale":"2024-04-25T13:41:06.272712+0000","last_undegraded":"2024-04-25T13:41:06.272712+0000","last_fullsized":"2024-04-25T13:41:06.272712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081075+0000","last_change":"2024-04-25T13:41:03.425103+0000","last_active":"2024-04-25T13:41:07.081075+0000","last_peered":"2024-04-25T13:41:07.081075+0000","last_clean":"2024-04-25T13:41:07.081075+0000","last_became_active":"2024-04-25T13:41:03.424688+0000","last_became_peered":"2024-04-25T13:41:03.424688+0000","last_unstale":"2024-04-25T13:41:07.081075+0000","last_undegraded":"2024-04-25T13:41:07.081075+0000","last_fullsized":"2024-04-25T13:41:07.081075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:51.359222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":666555,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":666611,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:41:11.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:41:11.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04fa39a640 1 Processor -- start 2024-04-25T13:41:11.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04fa39a640 1 -- start start 2024-04-25T13:41:11.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04fa39a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04f40a5da0 0x7f04f406f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04fa39a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 0x7f04f414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04fa39a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f40a8900 con 0x7f04f406fdf0 2024-04-25T13:41:11.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04fa39a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f04f4074770 con 0x7f04f40a5da0 2024-04-25T13:41:11.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04fa39a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f04f40a8ba0 con 0x7f04f4152dd0 2024-04-25T13:41:11.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04f3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04f40a5da0 0x7f04f406f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04f3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04f40a5da0 0x7f04f406f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42418/0 (socket says 172.21.15.77:42418) 2024-04-25T13:41:11.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04f3fff640 1 -- 172.21.15.77:0/2698912624 learned_addr learned my addr 172.21.15.77:0/2698912624 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:11.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04f8937640 1 --2- 172.21.15.77:0/2698912624 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 0x7f04f414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04f3fff640 1 -- 172.21.15.77:0/2698912624 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 msgr2=0x7f04f414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:11.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04f3fff640 1 --2- 172.21.15.77:0/2698912624 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 0x7f04f414f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04f3fff640 1 -- 172.21.15.77:0/2698912624 >> v1:172.21.15.96:6789/0 conn(0x7f04f406fdf0 legacy=0x7f04f41526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:11.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04f3fff640 1 -- 172.21.15.77:0/2698912624 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f40a7c00 con 0x7f04f40a5da0 2024-04-25T13:41:11.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.587+0000 7f04f8937640 1 --2- 172.21.15.77:0/2698912624 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 0x7f04f414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:11.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04f3fff640 1 --2- 172.21.15.77:0/2698912624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 0x7f04f406f8b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f04f406e3b0 tx=0x7f04e401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a76d907576bec3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:11.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04f2ffd640 1 -- 172.21.15.77:0/2698912624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40b0070 con 0x7f04f40a5da0 2024-04-25T13:41:11.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04f2ffd640 1 -- 172.21.15.77:0/2698912624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e40ab600 con 0x7f04f40a5da0 2024-04-25T13:41:11.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04f2ffd640 1 -- 172.21.15.77:0/2698912624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40ab9d0 con 0x7f04f40a5da0 2024-04-25T13:41:11.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04fa39a640 1 -- 172.21.15.77:0/2698912624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 msgr2=0x7f04f406f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04fa39a640 1 --2- 172.21.15.77:0/2698912624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 0x7f04f406f8b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f04f406e3b0 tx=0x7f04e401c470 comp rx=0 tx=0).stop 2024-04-25T13:41:11.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04fa39a640 1 -- 172.21.15.77:0/2698912624 shutdown_connections 2024-04-25T13:41:11.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04fa39a640 1 --2- 172.21.15.77:0/2698912624 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 0x7f04f414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04fa39a640 1 --2- 172.21.15.77:0/2698912624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 0x7f04f406f8b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04fa39a640 1 -- 172.21.15.77:0/2698912624 >> 172.21.15.77:0/2698912624 conn(0x7f04f40c02a0 msgr2=0x7f04f40c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:11.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04fa39a640 1 -- 172.21.15.77:0/2698912624 shutdown_connections 2024-04-25T13:41:11.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.591+0000 7f04fa39a640 1 -- 172.21.15.77:0/2698912624 wait complete. 2024-04-25T13:41:11.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 Processor -- start 2024-04-25T13:41:11.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 -- start start 2024-04-25T13:41:11.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04f406fdf0 0x7f04f413fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 0x7f04f41400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 0x7f04f41ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04f415c600 con 0x7f04f40a5da0 2024-04-25T13:41:11.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f04f415c480 con 0x7f04f406fdf0 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f04f415c780 con 0x7f04f4152dd0 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 0x7f04f41400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 0x7f04f41400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42424/0 (socket says 172.21.15.77:42424) 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f37fe640 1 -- 172.21.15.77:0/548226940 learned_addr learned my addr 172.21.15.77:0/548226940 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f8937640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 0x7f04f41ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f3fff640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04f406fdf0 0x7f04f413fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f37fe640 1 -- 172.21.15.77:0/548226940 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 msgr2=0x7f04f41ecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f37fe640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 0x7f04f41ecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f37fe640 1 -- 172.21.15.77:0/548226940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04f406fdf0 msgr2=0x7f04f413fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f37fe640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04f406fdf0 0x7f04f413fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f37fe640 1 -- 172.21.15.77:0/548226940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f4140610 con 0x7f04f40a5da0 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f3fff640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04f406fdf0 0x7f04f413fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f37fe640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 0x7f04f41400d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04e800b3e0 tx=0x7f04e800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f0ff9640 1 -- 172.21.15.77:0/548226940 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8015020 con 0x7f04f40a5da0 2024-04-25T13:41:11.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f0ff9640 1 -- 172.21.15.77:0/548226940 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e8011830 con 0x7f04f40a5da0 2024-04-25T13:41:11.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f4140f10 con 0x7f04f40a5da0 2024-04-25T13:41:11.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04f0ff9640 1 -- 172.21.15.77:0/548226940 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8011c60 con 0x7f04f40a5da0 2024-04-25T13:41:11.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f4140990 con 0x7f04f40a5da0 2024-04-25T13:41:11.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.595+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f406a280 con 0x7f04f40a5da0 2024-04-25T13:41:11.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.599+0000 7f04f0ff9640 1 -- 172.21.15.77:0/548226940 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f04e8018020 con 0x7f04f40a5da0 2024-04-25T13:41:11.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.599+0000 7f04f0ff9640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f04e006f430 0x7f04e0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.599+0000 7f04f3fff640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f04e006f430 0x7f04e0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.599+0000 7f04f0ff9640 1 -- 172.21.15.77:0/548226940 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04e808f180 con 0x7f04f40a5da0 2024-04-25T13:41:11.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.599+0000 7f04f3fff640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f04e006f430 0x7f04e0071940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f04f40c1250 tx=0x7f04e40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:11.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.603+0000 7f04f0ff9640 1 -- 172.21.15.77:0/548226940 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f04e801f020 con 0x7f04f40a5da0 2024-04-25T13:41:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.747+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04f4140d60 con 0x7f04e006f430 2024-04-25T13:41:11.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.763+0000 7f04f0ff9640 1 -- 172.21.15.77:0/548226940 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251902 (secure 0 0 0) 0x7f04f4140d60 con 0x7f04e006f430 2024-04-25T13:41:11.765 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:11.768 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T13:41:11.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f04e006f430 msgr2=0x7f04e0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f04e006f430 0x7f04e0071940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f04f40c1250 tx=0x7f04e40a6000 comp rx=0 tx=0).stop 2024-04-25T13:41:11.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 msgr2=0x7f04f41400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 0x7f04f41400d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04e800b3e0 tx=0x7f04e800b8a0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 shutdown_connections 2024-04-25T13:41:11.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f04e006f430 0x7f04e0071940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04f4152dd0 0x7f04f41ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40a5da0 0x7f04f41400d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 --2- 172.21.15.77:0/548226940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04f406fdf0 0x7f04f413fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 >> 172.21.15.77:0/548226940 conn(0x7f04f40c02a0 msgr2=0x7f04f4148340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 shutdown_connections 2024-04-25T13:41:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.767+0000 7f04fa39a640 1 -- 172.21.15.77:0/548226940 wait complete. 2024-04-25T13:41:11.787 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T13:41:10.366826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218076,"kb_used_data":1888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756644,"statfs":{"total":773094113280,"available":772870803456,"internally_reserved":0,"allocated":1933312,"data_stored":1790396,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.980368"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376520+0000","last_change":"2024-04-25T13:41:04.470225+0000","last_active":"2024-04-25T13:41:06.376520+0000","last_peered":"2024-04-25T13:41:06.376520+0000","last_clean":"2024-04-25T13:41:06.376520+0000","last_became_active":"2024-04-25T13:41:04.434108+0000","last_became_peered":"2024-04-25T13:41:04.434108+0000","last_unstale":"2024-04-25T13:41:06.376520+0000","last_undegraded":"2024-04-25T13:41:06.376520+0000","last_fullsized":"2024-04-25T13:41:06.376520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394570+0000","last_change":"2024-04-25T13:41:04.422886+0000","last_active":"2024-04-25T13:41:05.394570+0000","last_peered":"2024-04-25T13:41:05.394570+0000","last_clean":"2024-04-25T13:41:05.394570+0000","last_became_active":"2024-04-25T13:41:04.422546+0000","last_became_peered":"2024-04-25T13:41:04.422546+0000","last_unstale":"2024-04-25T13:41:05.394570+0000","last_undegraded":"2024-04-25T13:41:05.394570+0000","last_fullsized":"2024-04-25T13:41:05.394570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080522+0000","last_change":"2024-04-25T13:41:04.413021+0000","last_active":"2024-04-25T13:41:07.080522+0000","last_peered":"2024-04-25T13:41:07.080522+0000","last_clean":"2024-04-25T13:41:07.080522+0000","last_became_active":"2024-04-25T13:41:04.412382+0000","last_became_peered":"2024-04-25T13:41:04.412382+0000","last_unstale":"2024-04-25T13:41:07.080522+0000","last_undegraded":"2024-04-25T13:41:07.080522+0000","last_fullsized":"2024-04-25T13:41:07.080522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398030+0000","last_change":"2024-04-25T13:41:04.419756+0000","last_active":"2024-04-25T13:41:05.398030+0000","last_peered":"2024-04-25T13:41:05.398030+0000","last_clean":"2024-04-25T13:41:05.398030+0000","last_became_active":"2024-04-25T13:41:04.418367+0000","last_became_peered":"2024-04-25T13:41:04.418367+0000","last_unstale":"2024-04-25T13:41:05.398030+0000","last_undegraded":"2024-04-25T13:41:05.398030+0000","last_fullsized":"2024-04-25T13:41:05.398030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375397+0000","last_change":"2024-04-25T13:41:04.428788+0000","last_active":"2024-04-25T13:41:06.375397+0000","last_peered":"2024-04-25T13:41:06.375397+0000","last_clean":"2024-04-25T13:41:06.375397+0000","last_became_active":"2024-04-25T13:41:04.428424+0000","last_became_peered":"2024-04-25T13:41:04.428424+0000","last_unstale":"2024-04-25T13:41:06.375397+0000","last_undegraded":"2024-04-25T13:41:06.375397+0000","last_fullsized":"2024-04-25T13:41:06.375397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397757+0000","last_change":"2024-04-25T13:41:04.432387+0000","last_active":"2024-04-25T13:41:05.397757+0000","last_peered":"2024-04-25T13:41:05.397757+0000","last_clean":"2024-04-25T13:41:05.397757+0000","last_became_active":"2024-04-25T13:41:04.431971+0000","last_became_peered":"2024-04-25T13:41:04.431971+0000","last_unstale":"2024-04-25T13:41:05.397757+0000","last_undegraded":"2024-04-25T13:41:05.397757+0000","last_fullsized":"2024-04-25T13:41:05.397757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375149+0000","last_change":"2024-04-25T13:41:04.473786+0000","last_active":"2024-04-25T13:41:06.375149+0000","last_peered":"2024-04-25T13:41:06.375149+0000","last_clean":"2024-04-25T13:41:06.375149+0000","last_became_active":"2024-04-25T13:41:04.471082+0000","last_became_peered":"2024-04-25T13:41:04.471082+0000","last_unstale":"2024-04-25T13:41:06.375149+0000","last_undegraded":"2024-04-25T13:41:06.375149+0000","last_fullsized":"2024-04-25T13:41:06.375149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271553+0000","last_change":"2024-04-25T13:41:04.410956+0000","last_active":"2024-04-25T13:41:06.271553+0000","last_peered":"2024-04-25T13:41:06.271553+0000","last_clean":"2024-04-25T13:41:06.271553+0000","last_became_active":"2024-04-25T13:41:04.410665+0000","last_became_peered":"2024-04-25T13:41:04.410665+0000","last_unstale":"2024-04-25T13:41:06.271553+0000","last_undegraded":"2024-04-25T13:41:06.271553+0000","last_fullsized":"2024-04-25T13:41:06.271553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376873+0000","last_change":"2024-04-25T13:41:04.470410+0000","last_active":"2024-04-25T13:41:06.376873+0000","last_peered":"2024-04-25T13:41:06.376873+0000","last_clean":"2024-04-25T13:41:06.376873+0000","last_became_active":"2024-04-25T13:41:04.434676+0000","last_became_peered":"2024-04-25T13:41:04.434676+0000","last_unstale":"2024-04-25T13:41:06.376873+0000","last_undegraded":"2024-04-25T13:41:06.376873+0000","last_fullsized":"2024-04-25T13:41:06.376873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083063+0000","last_change":"2024-04-25T13:41:04.417498+0000","last_active":"2024-04-25T13:41:07.083063+0000","last_peered":"2024-04-25T13:41:07.083063+0000","last_clean":"2024-04-25T13:41:07.083063+0000","last_became_active":"2024-04-25T13:41:04.417145+0000","last_became_peered":"2024-04-25T13:41:04.417145+0000","last_unstale":"2024-04-25T13:41:07.083063+0000","last_undegraded":"2024-04-25T13:41:07.083063+0000","last_fullsized":"2024-04-25T13:41:07.083063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082677+0000","last_change":"2024-04-25T13:41:04.417324+0000","last_active":"2024-04-25T13:41:07.082677+0000","last_peered":"2024-04-25T13:41:07.082677+0000","last_clean":"2024-04-25T13:41:07.082677+0000","last_became_active":"2024-04-25T13:41:04.416982+0000","last_became_peered":"2024-04-25T13:41:04.416982+0000","last_unstale":"2024-04-25T13:41:07.082677+0000","last_undegraded":"2024-04-25T13:41:07.082677+0000","last_fullsized":"2024-04-25T13:41:07.082677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084913+0000","last_change":"2024-04-25T13:41:04.412869+0000","last_active":"2024-04-25T13:41:07.084913+0000","last_peered":"2024-04-25T13:41:07.084913+0000","last_clean":"2024-04-25T13:41:07.084913+0000","last_became_active":"2024-04-25T13:41:04.412544+0000","last_became_peered":"2024-04-25T13:41:04.412544+0000","last_unstale":"2024-04-25T13:41:07.084913+0000","last_undegraded":"2024-04-25T13:41:07.084913+0000","last_fullsized":"2024-04-25T13:41:07.084913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272972+0000","last_change":"2024-04-25T13:41:04.412143+0000","last_active":"2024-04-25T13:41:06.272972+0000","last_peered":"2024-04-25T13:41:06.272972+0000","last_clean":"2024-04-25T13:41:06.272972+0000","last_became_active":"2024-04-25T13:41:04.411840+0000","last_became_peered":"2024-04-25T13:41:04.411840+0000","last_unstale":"2024-04-25T13:41:06.272972+0000","last_undegraded":"2024-04-25T13:41:06.272972+0000","last_fullsized":"2024-04-25T13:41:06.272972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080138+0000","last_change":"2024-04-25T13:41:04.426859+0000","last_active":"2024-04-25T13:41:07.080138+0000","last_peered":"2024-04-25T13:41:07.080138+0000","last_clean":"2024-04-25T13:41:07.080138+0000","last_became_active":"2024-04-25T13:41:04.426437+0000","last_became_peered":"2024-04-25T13:41:04.426437+0000","last_unstale":"2024-04-25T13:41:07.080138+0000","last_undegraded":"2024-04-25T13:41:07.080138+0000","last_fullsized":"2024-04-25T13:41:07.080138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:21.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394006+0000","last_change":"2024-04-25T13:41:04.410712+0000","last_active":"2024-04-25T13:41:05.394006+0000","last_peered":"2024-04-25T13:41:05.394006+0000","last_clean":"2024-04-25T13:41:05.394006+0000","last_became_active":"2024-04-25T13:41:04.410362+0000","last_became_peered":"2024-04-25T13:41:04.410362+0000","last_unstale":"2024-04-25T13:41:05.394006+0000","last_undegraded":"2024-04-25T13:41:05.394006+0000","last_fullsized":"2024-04-25T13:41:05.394006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397254+0000","last_change":"2024-04-25T13:41:04.429493+0000","last_active":"2024-04-25T13:41:05.397254+0000","last_peered":"2024-04-25T13:41:05.397254+0000","last_clean":"2024-04-25T13:41:05.397254+0000","last_became_active":"2024-04-25T13:41:04.429116+0000","last_became_peered":"2024-04-25T13:41:04.429116+0000","last_unstale":"2024-04-25T13:41:05.397254+0000","last_undegraded":"2024-04-25T13:41:05.397254+0000","last_fullsized":"2024-04-25T13:41:05.397254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399835+0000","last_change":"2024-04-25T13:41:04.431688+0000","last_active":"2024-04-25T13:41:05.399835+0000","last_peered":"2024-04-25T13:41:05.399835+0000","last_clean":"2024-04-25T13:41:05.399835+0000","last_became_active":"2024-04-25T13:41:04.431231+0000","last_became_peered":"2024-04-25T13:41:04.431231+0000","last_unstale":"2024-04-25T13:41:05.399835+0000","last_undegraded":"2024-04-25T13:41:05.399835+0000","last_fullsized":"2024-04-25T13:41:05.399835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390359+0000","last_change":"2024-04-25T13:41:04.407914+0000","last_active":"2024-04-25T13:41:05.390359+0000","last_peered":"2024-04-25T13:41:05.390359+0000","last_clean":"2024-04-25T13:41:05.390359+0000","last_became_active":"2024-04-25T13:41:04.407553+0000","last_became_peered":"2024-04-25T13:41:04.407553+0000","last_unstale":"2024-04-25T13:41:05.390359+0000","last_undegraded":"2024-04-25T13:41:05.390359+0000","last_fullsized":"2024-04-25T13:41:05.390359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376272+0000","last_change":"2024-04-25T13:41:04.430301+0000","last_active":"2024-04-25T13:41:06.376272+0000","last_peered":"2024-04-25T13:41:06.376272+0000","last_clean":"2024-04-25T13:41:06.376272+0000","last_became_active":"2024-04-25T13:41:04.428597+0000","last_became_peered":"2024-04-25T13:41:04.428597+0000","last_unstale":"2024-04-25T13:41:06.376272+0000","last_undegraded":"2024-04-25T13:41:06.376272+0000","last_fullsized":"2024-04-25T13:41:06.376272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082158+0000","last_change":"2024-04-25T13:41:04.423772+0000","last_active":"2024-04-25T13:41:07.082158+0000","last_peered":"2024-04-25T13:41:07.082158+0000","last_clean":"2024-04-25T13:41:07.082158+0000","last_became_active":"2024-04-25T13:41:04.423453+0000","last_became_peered":"2024-04-25T13:41:04.423453+0000","last_unstale":"2024-04-25T13:41:07.082158+0000","last_undegraded":"2024-04-25T13:41:07.082158+0000","last_fullsized":"2024-04-25T13:41:07.082158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080752+0000","last_change":"2024-04-25T13:41:04.430195+0000","last_active":"2024-04-25T13:41:07.080752+0000","last_peered":"2024-04-25T13:41:07.080752+0000","last_clean":"2024-04-25T13:41:07.080752+0000","last_became_active":"2024-04-25T13:41:04.429917+0000","last_became_peered":"2024-04-25T13:41:04.429917+0000","last_unstale":"2024-04-25T13:41:07.080752+0000","last_undegraded":"2024-04-25T13:41:07.080752+0000","last_fullsized":"2024-04-25T13:41:07.080752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398046+0000","last_change":"2024-04-25T13:41:04.431579+0000","last_active":"2024-04-25T13:41:05.398046+0000","last_peered":"2024-04-25T13:41:05.398046+0000","last_clean":"2024-04-25T13:41:05.398046+0000","last_became_active":"2024-04-25T13:41:04.431160+0000","last_became_peered":"2024-04-25T13:41:04.431160+0000","last_unstale":"2024-04-25T13:41:05.398046+0000","last_undegraded":"2024-04-25T13:41:05.398046+0000","last_fullsized":"2024-04-25T13:41:05.398046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271836+0000","last_change":"2024-04-25T13:41:04.423185+0000","last_active":"2024-04-25T13:41:06.271836+0000","last_peered":"2024-04-25T13:41:06.271836+0000","last_clean":"2024-04-25T13:41:06.271836+0000","last_became_active":"2024-04-25T13:41:04.422815+0000","last_became_peered":"2024-04-25T13:41:04.422815+0000","last_unstale":"2024-04-25T13:41:06.271836+0000","last_undegraded":"2024-04-25T13:41:06.271836+0000","last_fullsized":"2024-04-25T13:41:06.271836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397647+0000","last_change":"2024-04-25T13:41:04.415522+0000","last_active":"2024-04-25T13:41:05.397647+0000","last_peered":"2024-04-25T13:41:05.397647+0000","last_clean":"2024-04-25T13:41:05.397647+0000","last_became_active":"2024-04-25T13:41:04.414898+0000","last_became_peered":"2024-04-25T13:41:04.414898+0000","last_unstale":"2024-04-25T13:41:05.397647+0000","last_undegraded":"2024-04-25T13:41:05.397647+0000","last_fullsized":"2024-04-25T13:41:05.397647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272770+0000","last_change":"2024-04-25T13:41:04.422142+0000","last_active":"2024-04-25T13:41:06.272770+0000","last_peered":"2024-04-25T13:41:06.272770+0000","last_clean":"2024-04-25T13:41:06.272770+0000","last_became_active":"2024-04-25T13:41:04.421279+0000","last_became_peered":"2024-04-25T13:41:04.421279+0000","last_unstale":"2024-04-25T13:41:06.272770+0000","last_undegraded":"2024-04-25T13:41:06.272770+0000","last_fullsized":"2024-04-25T13:41:06.272770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083116+0000","last_change":"2024-04-25T13:41:04.431595+0000","last_active":"2024-04-25T13:41:07.083116+0000","last_peered":"2024-04-25T13:41:07.083116+0000","last_clean":"2024-04-25T13:41:07.083116+0000","last_became_active":"2024-04-25T13:41:04.431130+0000","last_became_peered":"2024-04-25T13:41:04.431130+0000","last_unstale":"2024-04-25T13:41:07.083116+0000","last_undegraded":"2024-04-25T13:41:07.083116+0000","last_fullsized":"2024-04-25T13:41:07.083116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394417+0000","last_change":"2024-04-25T13:41:04.413732+0000","last_active":"2024-04-25T13:41:05.394417+0000","last_peered":"2024-04-25T13:41:05.394417+0000","last_clean":"2024-04-25T13:41:05.394417+0000","last_became_active":"2024-04-25T13:41:04.413001+0000","last_became_peered":"2024-04-25T13:41:04.413001+0000","last_unstale":"2024-04-25T13:41:05.394417+0000","last_undegraded":"2024-04-25T13:41:05.394417+0000","last_fullsized":"2024-04-25T13:41:05.394417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272664+0000","last_change":"2024-04-25T13:41:04.421963+0000","last_active":"2024-04-25T13:41:06.272664+0000","last_peered":"2024-04-25T13:41:06.272664+0000","last_clean":"2024-04-25T13:41:06.272664+0000","last_became_active":"2024-04-25T13:41:04.421439+0000","last_became_peered":"2024-04-25T13:41:04.421439+0000","last_unstale":"2024-04-25T13:41:06.272664+0000","last_undegraded":"2024-04-25T13:41:06.272664+0000","last_fullsized":"2024-04-25T13:41:06.272664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080989+0000","last_change":"2024-04-25T13:41:04.423204+0000","last_active":"2024-04-25T13:41:07.080989+0000","last_peered":"2024-04-25T13:41:07.080989+0000","last_clean":"2024-04-25T13:41:07.080989+0000","last_became_active":"2024-04-25T13:41:04.422855+0000","last_became_peered":"2024-04-25T13:41:04.422855+0000","last_unstale":"2024-04-25T13:41:07.080989+0000","last_undegraded":"2024-04-25T13:41:07.080989+0000","last_fullsized":"2024-04-25T13:41:07.080989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398240+0000","last_change":"2024-04-25T13:41:04.416506+0000","last_active":"2024-04-25T13:41:05.398240+0000","last_peered":"2024-04-25T13:41:05.398240+0000","last_clean":"2024-04-25T13:41:05.398240+0000","last_became_active":"2024-04-25T13:41:04.416177+0000","last_became_peered":"2024-04-25T13:41:04.416177+0000","last_unstale":"2024-04-25T13:41:05.398240+0000","last_undegraded":"2024-04-25T13:41:05.398240+0000","last_fullsized":"2024-04-25T13:41:05.398240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390077+0000","last_change":"2024-04-25T13:41:04.414817+0000","last_active":"2024-04-25T13:41:05.390077+0000","last_peered":"2024-04-25T13:41:05.390077+0000","last_clean":"2024-04-25T13:41:05.390077+0000","last_became_active":"2024-04-25T13:41:04.414178+0000","last_became_peered":"2024-04-25T13:41:04.414178+0000","last_unstale":"2024-04-25T13:41:05.390077+0000","last_undegraded":"2024-04-25T13:41:05.390077+0000","last_fullsized":"2024-04-25T13:41:05.390077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081720+0000","last_change":"2024-04-25T13:41:04.430078+0000","last_active":"2024-04-25T13:41:07.081720+0000","last_peered":"2024-04-25T13:41:07.081720+0000","last_clean":"2024-04-25T13:41:07.081720+0000","last_became_active":"2024-04-25T13:41:04.429518+0000","last_became_peered":"2024-04-25T13:41:04.429518+0000","last_unstale":"2024-04-25T13:41:07.081720+0000","last_undegraded":"2024-04-25T13:41:07.081720+0000","last_fullsized":"2024-04-25T13:41:07.081720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084010+0000","last_change":"2024-04-25T13:41:04.402158+0000","last_active":"2024-04-25T13:41:07.084010+0000","last_peered":"2024-04-25T13:41:07.084010+0000","last_clean":"2024-04-25T13:41:07.084010+0000","last_became_active":"2024-04-25T13:41:04.401821+0000","last_became_peered":"2024-04-25T13:41:04.401821+0000","last_unstale":"2024-04-25T13:41:07.084010+0000","last_undegraded":"2024-04-25T13:41:07.084010+0000","last_fullsized":"2024-04-25T13:41:07.084010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:18.457935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272477+0000","last_change":"2024-04-25T13:41:03.425690+0000","last_active":"2024-04-25T13:41:06.272477+0000","last_peered":"2024-04-25T13:41:06.272477+0000","last_clean":"2024-04-25T13:41:06.272477+0000","last_became_active":"2024-04-25T13:41:03.425239+0000","last_became_peered":"2024-04-25T13:41:03.425239+0000","last_unstale":"2024-04-25T13:41:06.272477+0000","last_undegraded":"2024-04-25T13:41:06.272477+0000","last_fullsized":"2024-04-25T13:41:06.272477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081045+0000","last_change":"2024-04-25T13:41:04.411250+0000","last_active":"2024-04-25T13:41:07.081045+0000","last_peered":"2024-04-25T13:41:07.081045+0000","last_clean":"2024-04-25T13:41:07.081045+0000","last_became_active":"2024-04-25T13:41:04.400223+0000","last_became_peered":"2024-04-25T13:41:04.400223+0000","last_unstale":"2024-04-25T13:41:07.081045+0000","last_undegraded":"2024-04-25T13:41:07.081045+0000","last_fullsized":"2024-04-25T13:41:07.081045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081971+0000","last_change":"2024-04-25T13:41:03.435467+0000","last_active":"2024-04-25T13:41:07.081971+0000","last_peered":"2024-04-25T13:41:07.081971+0000","last_clean":"2024-04-25T13:41:07.081971+0000","last_became_active":"2024-04-25T13:41:03.426677+0000","last_became_peered":"2024-04-25T13:41:03.426677+0000","last_unstale":"2024-04-25T13:41:07.081971+0000","last_undegraded":"2024-04-25T13:41:07.081971+0000","last_fullsized":"2024-04-25T13:41:07.081971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271566+0000","last_change":"2024-04-25T13:41:03.437180+0000","last_active":"2024-04-25T13:41:06.271566+0000","last_peered":"2024-04-25T13:41:06.271566+0000","last_clean":"2024-04-25T13:41:06.271566+0000","last_became_active":"2024-04-25T13:41:03.436905+0000","last_became_peered":"2024-04-25T13:41:03.436905+0000","last_unstale":"2024-04-25T13:41:06.271566+0000","last_undegraded":"2024-04-25T13:41:06.271566+0000","last_fullsized":"2024-04-25T13:41:06.271566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.271768+0000","last_change":"2024-04-25T13:41:04.423777+0000","last_active":"2024-04-25T13:41:06.271768+0000","last_peered":"2024-04-25T13:41:06.271768+0000","last_clean":"2024-04-25T13:41:06.271768+0000","last_became_active":"2024-04-25T13:41:04.423470+0000","last_became_peered":"2024-04-25T13:41:04.423470+0000","last_unstale":"2024-04-25T13:41:06.271768+0000","last_undegraded":"2024-04-25T13:41:06.271768+0000","last_fullsized":"2024-04-25T13:41:06.271768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397437+0000","last_change":"2024-04-25T13:41:03.445205+0000","last_active":"2024-04-25T13:41:05.397437+0000","last_peered":"2024-04-25T13:41:05.397437+0000","last_clean":"2024-04-25T13:41:05.397437+0000","last_became_active":"2024-04-25T13:41:03.444412+0000","last_became_peered":"2024-04-25T13:41:03.444412+0000","last_unstale":"2024-04-25T13:41:05.397437+0000","last_undegraded":"2024-04-25T13:41:05.397437+0000","last_fullsized":"2024-04-25T13:41:05.397437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.393826+0000","last_change":"2024-04-25T13:41:04.413827+0000","last_active":"2024-04-25T13:41:05.393826+0000","last_peered":"2024-04-25T13:41:05.393826+0000","last_clean":"2024-04-25T13:41:05.393826+0000","last_became_active":"2024-04-25T13:41:04.413496+0000","last_became_peered":"2024-04-25T13:41:04.413496+0000","last_unstale":"2024-04-25T13:41:05.393826+0000","last_undegraded":"2024-04-25T13:41:05.393826+0000","last_fullsized":"2024-04-25T13:41:05.393826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.082917+0000","last_change":"2024-04-25T13:41:03.450428+0000","last_active":"2024-04-25T13:41:07.082917+0000","last_peered":"2024-04-25T13:41:07.082917+0000","last_clean":"2024-04-25T13:41:07.082917+0000","last_became_active":"2024-04-25T13:41:03.449629+0000","last_became_peered":"2024-04-25T13:41:03.449629+0000","last_unstale":"2024-04-25T13:41:07.082917+0000","last_undegraded":"2024-04-25T13:41:07.082917+0000","last_fullsized":"2024-04-25T13:41:07.082917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399527+0000","last_change":"2024-04-25T13:41:04.431979+0000","last_active":"2024-04-25T13:41:05.399527+0000","last_peered":"2024-04-25T13:41:05.399527+0000","last_clean":"2024-04-25T13:41:05.399527+0000","last_became_active":"2024-04-25T13:41:04.431218+0000","last_became_peered":"2024-04-25T13:41:04.431218+0000","last_unstale":"2024-04-25T13:41:05.399527+0000","last_undegraded":"2024-04-25T13:41:05.399527+0000","last_fullsized":"2024-04-25T13:41:05.399527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399630+0000","last_change":"2024-04-25T13:41:03.445209+0000","last_active":"2024-04-25T13:41:05.399630+0000","last_peered":"2024-04-25T13:41:05.399630+0000","last_clean":"2024-04-25T13:41:05.399630+0000","last_became_active":"2024-04-25T13:41:03.444460+0000","last_became_peered":"2024-04-25T13:41:03.444460+0000","last_unstale":"2024-04-25T13:41:05.399630+0000","last_undegraded":"2024-04-25T13:41:05.399630+0000","last_fullsized":"2024-04-25T13:41:05.399630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080960+0000","last_change":"2024-04-25T13:41:04.423661+0000","last_active":"2024-04-25T13:41:07.080960+0000","last_peered":"2024-04-25T13:41:07.080960+0000","last_clean":"2024-04-25T13:41:07.080960+0000","last_became_active":"2024-04-25T13:41:04.421991+0000","last_became_peered":"2024-04-25T13:41:04.421991+0000","last_unstale":"2024-04-25T13:41:07.080960+0000","last_undegraded":"2024-04-25T13:41:07.080960+0000","last_fullsized":"2024-04-25T13:41:07.080960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394142+0000","last_change":"2024-04-25T13:41:03.443960+0000","last_active":"2024-04-25T13:41:05.394142+0000","last_peered":"2024-04-25T13:41:05.394142+0000","last_clean":"2024-04-25T13:41:05.394142+0000","last_became_active":"2024-04-25T13:41:03.443721+0000","last_became_peered":"2024-04-25T13:41:03.443721+0000","last_unstale":"2024-04-25T13:41:05.394142+0000","last_undegraded":"2024-04-25T13:41:05.394142+0000","last_fullsized":"2024-04-25T13:41:05.394142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.085160+0000","last_change":"2024-04-25T13:41:04.423896+0000","last_active":"2024-04-25T13:41:07.085160+0000","last_peered":"2024-04-25T13:41:07.085160+0000","last_clean":"2024-04-25T13:41:07.085160+0000","last_became_active":"2024-04-25T13:41:04.423569+0000","last_became_peered":"2024-04-25T13:41:04.423569+0000","last_unstale":"2024-04-25T13:41:07.085160+0000","last_undegraded":"2024-04-25T13:41:07.085160+0000","last_fullsized":"2024-04-25T13:41:07.085160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081924+0000","last_change":"2024-04-25T13:41:03.426055+0000","last_active":"2024-04-25T13:41:07.081924+0000","last_peered":"2024-04-25T13:41:07.081924+0000","last_clean":"2024-04-25T13:41:07.081924+0000","last_became_active":"2024-04-25T13:41:03.424990+0000","last_became_peered":"2024-04-25T13:41:03.424990+0000","last_unstale":"2024-04-25T13:41:07.081924+0000","last_undegraded":"2024-04-25T13:41:07.081924+0000","last_fullsized":"2024-04-25T13:41:07.081924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375890+0000","last_change":"2024-04-25T13:41:04.430564+0000","last_active":"2024-04-25T13:41:06.375890+0000","last_peered":"2024-04-25T13:41:06.375890+0000","last_clean":"2024-04-25T13:41:06.375890+0000","last_became_active":"2024-04-25T13:41:04.427802+0000","last_became_peered":"2024-04-25T13:41:04.427802+0000","last_unstale":"2024-04-25T13:41:06.375890+0000","last_undegraded":"2024-04-25T13:41:06.375890+0000","last_fullsized":"2024-04-25T13:41:06.375890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081161+0000","last_change":"2024-04-25T13:41:03.422851+0000","last_active":"2024-04-25T13:41:07.081161+0000","last_peered":"2024-04-25T13:41:07.081161+0000","last_clean":"2024-04-25T13:41:07.081161+0000","last_became_active":"2024-04-25T13:41:03.422529+0000","last_became_peered":"2024-04-25T13:41:03.422529+0000","last_unstale":"2024-04-25T13:41:07.081161+0000","last_undegraded":"2024-04-25T13:41:07.081161+0000","last_fullsized":"2024-04-25T13:41:07.081161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080588+0000","last_change":"2024-04-25T13:41:04.429077+0000","last_active":"2024-04-25T13:41:07.080588+0000","last_peered":"2024-04-25T13:41:07.080588+0000","last_clean":"2024-04-25T13:41:07.080588+0000","last_became_active":"2024-04-25T13:41:04.428641+0000","last_became_peered":"2024-04-25T13:41:04.428641+0000","last_unstale":"2024-04-25T13:41:07.080588+0000","last_undegraded":"2024-04-25T13:41:07.080588+0000","last_fullsized":"2024-04-25T13:41:07.080588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398137+0000","last_change":"2024-04-25T13:41:03.450649+0000","last_active":"2024-04-25T13:41:05.398137+0000","last_peered":"2024-04-25T13:41:05.398137+0000","last_clean":"2024-04-25T13:41:05.398137+0000","last_became_active":"2024-04-25T13:41:03.449872+0000","last_became_peered":"2024-04-25T13:41:03.449872+0000","last_unstale":"2024-04-25T13:41:05.398137+0000","last_undegraded":"2024-04-25T13:41:05.398137+0000","last_fullsized":"2024-04-25T13:41:05.398137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375589+0000","last_change":"2024-04-25T13:41:04.434947+0000","last_active":"2024-04-25T13:41:06.375589+0000","last_peered":"2024-04-25T13:41:06.375589+0000","last_clean":"2024-04-25T13:41:06.375589+0000","last_became_active":"2024-04-25T13:41:04.434502+0000","last_became_peered":"2024-04-25T13:41:04.434502+0000","last_unstale":"2024-04-25T13:41:06.375589+0000","last_undegraded":"2024-04-25T13:41:06.375589+0000","last_fullsized":"2024-04-25T13:41:06.375589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081461+0000","last_change":"2024-04-25T13:41:03.423826+0000","last_active":"2024-04-25T13:41:07.081461+0000","last_peered":"2024-04-25T13:41:07.081461+0000","last_clean":"2024-04-25T13:41:07.081461+0000","last_became_active":"2024-04-25T13:41:03.423037+0000","last_became_peered":"2024-04-25T13:41:03.423037+0000","last_unstale":"2024-04-25T13:41:07.081461+0000","last_undegraded":"2024-04-25T13:41:07.081461+0000","last_fullsized":"2024-04-25T13:41:07.081461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081702+0000","last_change":"2024-04-25T13:41:04.429831+0000","last_active":"2024-04-25T13:41:07.081702+0000","last_peered":"2024-04-25T13:41:07.081702+0000","last_clean":"2024-04-25T13:41:07.081702+0000","last_became_active":"2024-04-25T13:41:04.429110+0000","last_became_peered":"2024-04-25T13:41:04.429110+0000","last_unstale":"2024-04-25T13:41:07.081702+0000","last_undegraded":"2024-04-25T13:41:07.081702+0000","last_fullsized":"2024-04-25T13:41:07.081702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.389771+0000","last_change":"2024-04-25T13:41:03.409148+0000","last_active":"2024-04-25T13:41:05.389771+0000","last_peered":"2024-04-25T13:41:05.389771+0000","last_clean":"2024-04-25T13:41:05.389771+0000","last_became_active":"2024-04-25T13:41:03.408414+0000","last_became_peered":"2024-04-25T13:41:03.408414+0000","last_unstale":"2024-04-25T13:41:05.389771+0000","last_undegraded":"2024-04-25T13:41:05.389771+0000","last_fullsized":"2024-04-25T13:41:05.389771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375388+0000","last_change":"2024-04-25T13:41:04.426477+0000","last_active":"2024-04-25T13:41:06.375388+0000","last_peered":"2024-04-25T13:41:06.375388+0000","last_clean":"2024-04-25T13:41:06.375388+0000","last_became_active":"2024-04-25T13:41:04.425891+0000","last_became_peered":"2024-04-25T13:41:04.425891+0000","last_unstale":"2024-04-25T13:41:06.375388+0000","last_undegraded":"2024-04-25T13:41:06.375388+0000","last_fullsized":"2024-04-25T13:41:06.375388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084806+0000","last_change":"2024-04-25T13:41:03.421716+0000","last_active":"2024-04-25T13:41:07.084806+0000","last_peered":"2024-04-25T13:41:07.084806+0000","last_clean":"2024-04-25T13:41:07.084806+0000","last_became_active":"2024-04-25T13:41:03.420848+0000","last_became_peered":"2024-04-25T13:41:03.420848+0000","last_unstale":"2024-04-25T13:41:07.084806+0000","last_undegraded":"2024-04-25T13:41:07.084806+0000","last_fullsized":"2024-04-25T13:41:07.084806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.389116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376433+0000","last_change":"2024-04-25T13:41:04.429840+0000","last_active":"2024-04-25T13:41:06.376433+0000","last_peered":"2024-04-25T13:41:06.376433+0000","last_clean":"2024-04-25T13:41:06.376433+0000","last_became_active":"2024-04-25T13:41:04.429404+0000","last_became_peered":"2024-04-25T13:41:04.429404+0000","last_unstale":"2024-04-25T13:41:06.376433+0000","last_undegraded":"2024-04-25T13:41:06.376433+0000","last_fullsized":"2024-04-25T13:41:06.376433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390507+0000","last_change":"2024-04-25T13:41:03.415723+0000","last_active":"2024-04-25T13:41:05.390507+0000","last_peered":"2024-04-25T13:41:05.390507+0000","last_clean":"2024-04-25T13:41:05.390507+0000","last_became_active":"2024-04-25T13:41:03.414957+0000","last_became_peered":"2024-04-25T13:41:03.414957+0000","last_unstale":"2024-04-25T13:41:05.390507+0000","last_undegraded":"2024-04-25T13:41:05.390507+0000","last_fullsized":"2024-04-25T13:41:05.390507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376788+0000","last_change":"2024-04-25T13:41:04.434675+0000","last_active":"2024-04-25T13:41:06.376788+0000","last_peered":"2024-04-25T13:41:06.376788+0000","last_clean":"2024-04-25T13:41:06.376788+0000","last_became_active":"2024-04-25T13:41:04.434194+0000","last_became_peered":"2024-04-25T13:41:04.434194+0000","last_unstale":"2024-04-25T13:41:06.376788+0000","last_undegraded":"2024-04-25T13:41:06.376788+0000","last_fullsized":"2024-04-25T13:41:06.376788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394277+0000","last_change":"2024-04-25T13:41:03.402131+0000","last_active":"2024-04-25T13:41:05.394277+0000","last_peered":"2024-04-25T13:41:05.394277+0000","last_clean":"2024-04-25T13:41:05.394277+0000","last_became_active":"2024-04-25T13:41:03.401398+0000","last_became_peered":"2024-04-25T13:41:03.401398+0000","last_unstale":"2024-04-25T13:41:05.394277+0000","last_undegraded":"2024-04-25T13:41:05.394277+0000","last_fullsized":"2024-04-25T13:41:05.394277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398944+0000","last_change":"2024-04-25T13:41:04.418743+0000","last_active":"2024-04-25T13:41:05.398944+0000","last_peered":"2024-04-25T13:41:05.398944+0000","last_clean":"2024-04-25T13:41:05.398944+0000","last_became_active":"2024-04-25T13:41:04.417963+0000","last_became_peered":"2024-04-25T13:41:04.417963+0000","last_unstale":"2024-04-25T13:41:05.398944+0000","last_undegraded":"2024-04-25T13:41:05.398944+0000","last_fullsized":"2024-04-25T13:41:05.398944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390275+0000","last_change":"2024-04-25T13:41:03.445729+0000","last_active":"2024-04-25T13:41:05.390275+0000","last_peered":"2024-04-25T13:41:05.390275+0000","last_clean":"2024-04-25T13:41:05.390275+0000","last_became_active":"2024-04-25T13:41:03.445293+0000","last_became_peered":"2024-04-25T13:41:03.445293+0000","last_unstale":"2024-04-25T13:41:05.390275+0000","last_undegraded":"2024-04-25T13:41:05.390275+0000","last_fullsized":"2024-04-25T13:41:05.390275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375956+0000","last_change":"2024-04-25T13:41:04.429996+0000","last_active":"2024-04-25T13:41:06.375956+0000","last_peered":"2024-04-25T13:41:06.375956+0000","last_clean":"2024-04-25T13:41:06.375956+0000","last_became_active":"2024-04-25T13:41:04.428232+0000","last_became_peered":"2024-04-25T13:41:04.428232+0000","last_unstale":"2024-04-25T13:41:06.375956+0000","last_undegraded":"2024-04-25T13:41:06.375956+0000","last_fullsized":"2024-04-25T13:41:06.375956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375088+0000","last_change":"2024-04-25T13:41:00.175142+0000","last_active":"2024-04-25T13:41:06.375088+0000","last_peered":"2024-04-25T13:41:06.375088+0000","last_clean":"2024-04-25T13:41:06.375088+0000","last_became_active":"2024-04-25T13:41:00.172906+0000","last_became_peered":"2024-04-25T13:41:00.172906+0000","last_unstale":"2024-04-25T13:41:06.375088+0000","last_undegraded":"2024-04-25T13:41:06.375088+0000","last_fullsized":"2024-04-25T13:41:06.375088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_clean_scrub_stamp":"2024-04-25T13:40:59.093070+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:38.020124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.397151+0000","last_change":"2024-04-25T13:41:03.438420+0000","last_active":"2024-04-25T13:41:05.397151+0000","last_peered":"2024-04-25T13:41:05.397151+0000","last_clean":"2024-04-25T13:41:05.397151+0000","last_became_active":"2024-04-25T13:41:03.437569+0000","last_became_peered":"2024-04-25T13:41:03.437569+0000","last_unstale":"2024-04-25T13:41:05.397151+0000","last_undegraded":"2024-04-25T13:41:05.397151+0000","last_fullsized":"2024-04-25T13:41:05.397151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272317+0000","last_change":"2024-04-25T13:41:04.417328+0000","last_active":"2024-04-25T13:41:06.272317+0000","last_peered":"2024-04-25T13:41:06.272317+0000","last_clean":"2024-04-25T13:41:06.272317+0000","last_became_active":"2024-04-25T13:41:04.416666+0000","last_became_peered":"2024-04-25T13:41:04.416666+0000","last_unstale":"2024-04-25T13:41:06.272317+0000","last_undegraded":"2024-04-25T13:41:06.272317+0000","last_fullsized":"2024-04-25T13:41:06.272317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.374736+0000","last_change":"2024-04-25T13:41:03.431855+0000","last_active":"2024-04-25T13:41:06.374736+0000","last_peered":"2024-04-25T13:41:06.374736+0000","last_clean":"2024-04-25T13:41:06.374736+0000","last_became_active":"2024-04-25T13:41:03.429200+0000","last_became_peered":"2024-04-25T13:41:03.429200+0000","last_unstale":"2024-04-25T13:41:06.374736+0000","last_undegraded":"2024-04-25T13:41:06.374736+0000","last_fullsized":"2024-04-25T13:41:06.374736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080267+0000","last_change":"2024-04-25T13:41:04.411548+0000","last_active":"2024-04-25T13:41:07.080267+0000","last_peered":"2024-04-25T13:41:07.080267+0000","last_clean":"2024-04-25T13:41:07.080267+0000","last_became_active":"2024-04-25T13:41:04.400093+0000","last_became_peered":"2024-04-25T13:41:04.400093+0000","last_unstale":"2024-04-25T13:41:07.080267+0000","last_undegraded":"2024-04-25T13:41:07.080267+0000","last_fullsized":"2024-04-25T13:41:07.080267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:09.999429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.390174+0000","last_change":"2024-04-25T13:41:03.415949+0000","last_active":"2024-04-25T13:41:05.390174+0000","last_peered":"2024-04-25T13:41:05.390174+0000","last_clean":"2024-04-25T13:41:05.390174+0000","last_became_active":"2024-04-25T13:41:03.414899+0000","last_became_peered":"2024-04-25T13:41:03.414899+0000","last_unstale":"2024-04-25T13:41:05.390174+0000","last_undegraded":"2024-04-25T13:41:05.390174+0000","last_fullsized":"2024-04-25T13:41:05.390174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394211+0000","last_change":"2024-04-25T13:41:04.403032+0000","last_active":"2024-04-25T13:41:05.394211+0000","last_peered":"2024-04-25T13:41:05.394211+0000","last_clean":"2024-04-25T13:41:05.394211+0000","last_became_active":"2024-04-25T13:41:04.402055+0000","last_became_peered":"2024-04-25T13:41:04.402055+0000","last_unstale":"2024-04-25T13:41:05.394211+0000","last_undegraded":"2024-04-25T13:41:05.394211+0000","last_fullsized":"2024-04-25T13:41:05.394211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398292+0000","last_change":"2024-04-25T13:41:03.447547+0000","last_active":"2024-04-25T13:41:05.398292+0000","last_peered":"2024-04-25T13:41:05.398292+0000","last_clean":"2024-04-25T13:41:05.398292+0000","last_became_active":"2024-04-25T13:41:03.444429+0000","last_became_peered":"2024-04-25T13:41:03.444429+0000","last_unstale":"2024-04-25T13:41:05.398292+0000","last_undegraded":"2024-04-25T13:41:05.398292+0000","last_fullsized":"2024-04-25T13:41:05.398292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.084597+0000","last_change":"2024-04-25T13:41:04.398647+0000","last_active":"2024-04-25T13:41:07.084597+0000","last_peered":"2024-04-25T13:41:07.084597+0000","last_clean":"2024-04-25T13:41:07.084597+0000","last_became_active":"2024-04-25T13:41:04.398287+0000","last_became_peered":"2024-04-25T13:41:04.398287+0000","last_unstale":"2024-04-25T13:41:07.084597+0000","last_undegraded":"2024-04-25T13:41:07.084597+0000","last_fullsized":"2024-04-25T13:41:07.084597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:06.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394703+0000","last_change":"2024-04-25T13:41:03.414535+0000","last_active":"2024-04-25T13:41:05.394703+0000","last_peered":"2024-04-25T13:41:05.394703+0000","last_clean":"2024-04-25T13:41:05.394703+0000","last_became_active":"2024-04-25T13:41:03.414145+0000","last_became_peered":"2024-04-25T13:41:03.414145+0000","last_unstale":"2024-04-25T13:41:05.394703+0000","last_undegraded":"2024-04-25T13:41:05.394703+0000","last_fullsized":"2024-04-25T13:41:05.394703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399648+0000","last_change":"2024-04-25T13:41:04.419186+0000","last_active":"2024-04-25T13:41:05.399648+0000","last_peered":"2024-04-25T13:41:05.399648+0000","last_clean":"2024-04-25T13:41:05.399648+0000","last_became_active":"2024-04-25T13:41:04.417831+0000","last_became_peered":"2024-04-25T13:41:04.417831+0000","last_unstale":"2024-04-25T13:41:05.399648+0000","last_undegraded":"2024-04-25T13:41:05.399648+0000","last_fullsized":"2024-04-25T13:41:05.399648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376400+0000","last_change":"2024-04-25T13:41:03.424206+0000","last_active":"2024-04-25T13:41:06.376400+0000","last_peered":"2024-04-25T13:41:06.376400+0000","last_clean":"2024-04-25T13:41:06.376400+0000","last_became_active":"2024-04-25T13:41:03.423176+0000","last_became_peered":"2024-04-25T13:41:03.423176+0000","last_unstale":"2024-04-25T13:41:06.376400+0000","last_undegraded":"2024-04-25T13:41:06.376400+0000","last_fullsized":"2024-04-25T13:41:06.376400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:23.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394828+0000","last_change":"2024-04-25T13:41:04.402353+0000","last_active":"2024-04-25T13:41:05.394828+0000","last_peered":"2024-04-25T13:41:05.394828+0000","last_clean":"2024-04-25T13:41:05.394828+0000","last_became_active":"2024-04-25T13:41:04.402014+0000","last_became_peered":"2024-04-25T13:41:04.402014+0000","last_unstale":"2024-04-25T13:41:05.394828+0000","last_undegraded":"2024-04-25T13:41:05.394828+0000","last_fullsized":"2024-04-25T13:41:05.394828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394770+0000","last_change":"2024-04-25T13:41:03.439449+0000","last_active":"2024-04-25T13:41:05.394770+0000","last_peered":"2024-04-25T13:41:05.394770+0000","last_clean":"2024-04-25T13:41:05.394770+0000","last_became_active":"2024-04-25T13:41:03.439074+0000","last_became_peered":"2024-04-25T13:41:03.439074+0000","last_unstale":"2024-04-25T13:41:05.394770+0000","last_undegraded":"2024-04-25T13:41:05.394770+0000","last_fullsized":"2024-04-25T13:41:05.394770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272770+0000","last_change":"2024-04-25T13:41:04.418630+0000","last_active":"2024-04-25T13:41:06.272770+0000","last_peered":"2024-04-25T13:41:06.272770+0000","last_clean":"2024-04-25T13:41:06.272770+0000","last_became_active":"2024-04-25T13:41:04.418330+0000","last_became_peered":"2024-04-25T13:41:04.418330+0000","last_unstale":"2024-04-25T13:41:06.272770+0000","last_undegraded":"2024-04-25T13:41:06.272770+0000","last_fullsized":"2024-04-25T13:41:06.272770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083247+0000","last_change":"2024-04-25T13:41:03.435851+0000","last_active":"2024-04-25T13:41:07.083247+0000","last_peered":"2024-04-25T13:41:07.083247+0000","last_clean":"2024-04-25T13:41:07.083247+0000","last_became_active":"2024-04-25T13:41:03.434870+0000","last_became_peered":"2024-04-25T13:41:03.434870+0000","last_unstale":"2024-04-25T13:41:07.083247+0000","last_undegraded":"2024-04-25T13:41:07.083247+0000","last_fullsized":"2024-04-25T13:41:07.083247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.080993+0000","last_change":"2024-04-25T13:41:04.426962+0000","last_active":"2024-04-25T13:41:07.080993+0000","last_peered":"2024-04-25T13:41:07.080993+0000","last_clean":"2024-04-25T13:41:07.080993+0000","last_became_active":"2024-04-25T13:41:04.426424+0000","last_became_peered":"2024-04-25T13:41:04.426424+0000","last_unstale":"2024-04-25T13:41:07.080993+0000","last_undegraded":"2024-04-25T13:41:07.080993+0000","last_fullsized":"2024-04-25T13:41:07.080993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.374720+0000","last_change":"2024-04-25T13:41:03.430095+0000","last_active":"2024-04-25T13:41:06.374720+0000","last_peered":"2024-04-25T13:41:06.374720+0000","last_clean":"2024-04-25T13:41:06.374720+0000","last_became_active":"2024-04-25T13:41:03.429094+0000","last_became_peered":"2024-04-25T13:41:03.429094+0000","last_unstale":"2024-04-25T13:41:06.374720+0000","last_undegraded":"2024-04-25T13:41:06.374720+0000","last_fullsized":"2024-04-25T13:41:06.374720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.083934+0000","last_change":"2024-04-25T13:41:04.413097+0000","last_active":"2024-04-25T13:41:07.083934+0000","last_peered":"2024-04-25T13:41:07.083934+0000","last_clean":"2024-04-25T13:41:07.083934+0000","last_became_active":"2024-04-25T13:41:04.412572+0000","last_became_peered":"2024-04-25T13:41:04.412572+0000","last_unstale":"2024-04-25T13:41:07.083934+0000","last_undegraded":"2024-04-25T13:41:07.083934+0000","last_fullsized":"2024-04-25T13:41:07.083934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:50.740570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394078+0000","last_change":"2024-04-25T13:41:03.411890+0000","last_active":"2024-04-25T13:41:05.394078+0000","last_peered":"2024-04-25T13:41:05.394078+0000","last_clean":"2024-04-25T13:41:05.394078+0000","last_became_active":"2024-04-25T13:41:03.411481+0000","last_became_peered":"2024-04-25T13:41:03.411481+0000","last_unstale":"2024-04-25T13:41:05.394078+0000","last_undegraded":"2024-04-25T13:41:05.394078+0000","last_fullsized":"2024-04-25T13:41:05.394078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272095+0000","last_change":"2024-04-25T13:41:04.408896+0000","last_active":"2024-04-25T13:41:06.272095+0000","last_peered":"2024-04-25T13:41:06.272095+0000","last_clean":"2024-04-25T13:41:06.272095+0000","last_became_active":"2024-04-25T13:41:04.408517+0000","last_became_peered":"2024-04-25T13:41:04.408517+0000","last_unstale":"2024-04-25T13:41:06.272095+0000","last_undegraded":"2024-04-25T13:41:06.272095+0000","last_fullsized":"2024-04-25T13:41:06.272095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.394550+0000","last_change":"2024-04-25T13:41:03.408129+0000","last_active":"2024-04-25T13:41:05.394550+0000","last_peered":"2024-04-25T13:41:05.394550+0000","last_clean":"2024-04-25T13:41:05.394550+0000","last_became_active":"2024-04-25T13:41:03.407713+0000","last_became_peered":"2024-04-25T13:41:03.407713+0000","last_unstale":"2024-04-25T13:41:05.394550+0000","last_undegraded":"2024-04-25T13:41:05.394550+0000","last_fullsized":"2024-04-25T13:41:05.394550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272097+0000","last_change":"2024-04-25T13:41:04.424601+0000","last_active":"2024-04-25T13:41:06.272097+0000","last_peered":"2024-04-25T13:41:06.272097+0000","last_clean":"2024-04-25T13:41:06.272097+0000","last_became_active":"2024-04-25T13:41:04.424153+0000","last_became_peered":"2024-04-25T13:41:04.424153+0000","last_unstale":"2024-04-25T13:41:06.272097+0000","last_undegraded":"2024-04-25T13:41:06.272097+0000","last_fullsized":"2024-04-25T13:41:06.272097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375586+0000","last_change":"2024-04-25T13:41:03.431525+0000","last_active":"2024-04-25T13:41:06.375586+0000","last_peered":"2024-04-25T13:41:06.375586+0000","last_clean":"2024-04-25T13:41:06.375586+0000","last_became_active":"2024-04-25T13:41:03.430716+0000","last_became_peered":"2024-04-25T13:41:03.430716+0000","last_unstale":"2024-04-25T13:41:06.375586+0000","last_undegraded":"2024-04-25T13:41:06.375586+0000","last_fullsized":"2024-04-25T13:41:06.375586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:46.480379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081813+0000","last_change":"2024-04-25T13:41:04.424614+0000","last_active":"2024-04-25T13:41:07.081813+0000","last_peered":"2024-04-25T13:41:07.081813+0000","last_clean":"2024-04-25T13:41:07.081813+0000","last_became_active":"2024-04-25T13:41:04.424248+0000","last_became_peered":"2024-04-25T13:41:04.424248+0000","last_unstale":"2024-04-25T13:41:07.081813+0000","last_undegraded":"2024-04-25T13:41:07.081813+0000","last_fullsized":"2024-04-25T13:41:07.081813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.399200+0000","last_change":"2024-04-25T13:41:04.425893+0000","last_active":"2024-04-25T13:41:05.399200+0000","last_peered":"2024-04-25T13:41:05.399200+0000","last_clean":"2024-04-25T13:41:05.399200+0000","last_became_active":"2024-04-25T13:41:04.424475+0000","last_became_peered":"2024-04-25T13:41:04.424475+0000","last_unstale":"2024-04-25T13:41:05.399200+0000","last_undegraded":"2024-04-25T13:41:05.399200+0000","last_fullsized":"2024-04-25T13:41:05.399200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.375539+0000","last_change":"2024-04-25T13:41:03.447296+0000","last_active":"2024-04-25T13:41:06.375539+0000","last_peered":"2024-04-25T13:41:06.375539+0000","last_clean":"2024-04-25T13:41:06.375539+0000","last_became_active":"2024-04-25T13:41:03.446522+0000","last_became_peered":"2024-04-25T13:41:03.446522+0000","last_unstale":"2024-04-25T13:41:06.375539+0000","last_undegraded":"2024-04-25T13:41:06.375539+0000","last_fullsized":"2024-04-25T13:41:06.375539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:05.398474+0000","last_change":"2024-04-25T13:41:04.424211+0000","last_active":"2024-04-25T13:41:05.398474+0000","last_peered":"2024-04-25T13:41:05.398474+0000","last_clean":"2024-04-25T13:41:05.398474+0000","last_became_active":"2024-04-25T13:41:04.423899+0000","last_became_peered":"2024-04-25T13:41:04.423899+0000","last_unstale":"2024-04-25T13:41:05.398474+0000","last_undegraded":"2024-04-25T13:41:05.398474+0000","last_fullsized":"2024-04-25T13:41:05.398474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.376048+0000","last_change":"2024-04-25T13:41:03.441717+0000","last_active":"2024-04-25T13:41:06.376048+0000","last_peered":"2024-04-25T13:41:06.376048+0000","last_clean":"2024-04-25T13:41:06.376048+0000","last_became_active":"2024-04-25T13:41:03.440886+0000","last_became_peered":"2024-04-25T13:41:03.440886+0000","last_unstale":"2024-04-25T13:41:06.376048+0000","last_undegraded":"2024-04-25T13:41:06.376048+0000","last_fullsized":"2024-04-25T13:41:06.376048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081156+0000","last_change":"2024-04-25T13:41:04.423577+0000","last_active":"2024-04-25T13:41:07.081156+0000","last_peered":"2024-04-25T13:41:07.081156+0000","last_clean":"2024-04-25T13:41:07.081156+0000","last_became_active":"2024-04-25T13:41:04.422496+0000","last_became_peered":"2024-04-25T13:41:04.422496+0000","last_unstale":"2024-04-25T13:41:07.081156+0000","last_undegraded":"2024-04-25T13:41:07.081156+0000","last_fullsized":"2024-04-25T13:41:07.081156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272735+0000","last_change":"2024-04-25T13:41:03.418067+0000","last_active":"2024-04-25T13:41:06.272735+0000","last_peered":"2024-04-25T13:41:06.272735+0000","last_clean":"2024-04-25T13:41:06.272735+0000","last_became_active":"2024-04-25T13:41:03.417592+0000","last_became_peered":"2024-04-25T13:41:03.417592+0000","last_unstale":"2024-04-25T13:41:06.272735+0000","last_undegraded":"2024-04-25T13:41:06.272735+0000","last_fullsized":"2024-04-25T13:41:06.272735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:06.272712+0000","last_change":"2024-04-25T13:41:04.410387+0000","last_active":"2024-04-25T13:41:06.272712+0000","last_peered":"2024-04-25T13:41:06.272712+0000","last_clean":"2024-04-25T13:41:06.272712+0000","last_became_active":"2024-04-25T13:41:04.410065+0000","last_became_peered":"2024-04-25T13:41:04.410065+0000","last_unstale":"2024-04-25T13:41:06.272712+0000","last_undegraded":"2024-04-25T13:41:06.272712+0000","last_fullsized":"2024-04-25T13:41:06.272712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:41:07.081075+0000","last_change":"2024-04-25T13:41:03.425103+0000","last_active":"2024-04-25T13:41:07.081075+0000","last_peered":"2024-04-25T13:41:07.081075+0000","last_clean":"2024-04-25T13:41:07.081075+0000","last_became_active":"2024-04-25T13:41:03.424688+0000","last_became_peered":"2024-04-25T13:41:03.424688+0000","last_unstale":"2024-04-25T13:41:07.081075+0000","last_undegraded":"2024-04-25T13:41:07.081075+0000","last_fullsized":"2024-04-25T13:41:07.081075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:51.359222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":666555,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":666611,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:41:11.790 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:41:11.791 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T13:41:11.791 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T13:41:11.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:41:11.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.967+0000 7f2c52df5640 1 Processor -- start 2024-04-25T13:41:11.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.967+0000 7f2c52df5640 1 -- start start 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c52df5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c4c1530d0 0x7f2c4c06eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c52df5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 0x7f2c4c070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c52df5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c4c0a5920 0x7f2c4c071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c52df5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4c0a62e0 con 0x7f2c4c0a5920 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c52df5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4c06e1f0 con 0x7f2c4c1530d0 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c52df5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4c0a6530 con 0x7f2c4c06f0e0 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c51392640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c4c0a5920 0x7f2c4c071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c51392640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c4c0a5920 0x7f2c4c071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42426/0 (socket says 172.21.15.77:42426) 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c51392640 1 -- 172.21.15.77:0/2948222722 learned_addr learned my addr 172.21.15.77:0/2948222722 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c4bfff640 1 --2- 172.21.15.77:0/2948222722 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 0x7f2c4c070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c50b91640 1 --2- 172.21.15.77:0/2948222722 >> v2:172.21.15.96:3300/0 conn(0x7f2c4c1530d0 0x7f2c4c06eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c51392640 1 -- 172.21.15.77:0/2948222722 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 msgr2=0x7f2c4c070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c51392640 1 --2- 172.21.15.77:0/2948222722 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 0x7f2c4c070be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c51392640 1 -- 172.21.15.77:0/2948222722 >> v2:172.21.15.96:3300/0 conn(0x7f2c4c1530d0 msgr2=0x7f2c4c06eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c51392640 1 --2- 172.21.15.77:0/2948222722 >> v2:172.21.15.96:3300/0 conn(0x7f2c4c1530d0 0x7f2c4c06eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c51392640 1 -- 172.21.15.77:0/2948222722 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c06e680 con 0x7f2c4c0a5920 2024-04-25T13:41:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c50b91640 1 --2- 172.21.15.77:0/2948222722 >> v2:172.21.15.96:3300/0 conn(0x7f2c4c1530d0 0x7f2c4c06eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:11.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c51392640 1 --2- 172.21.15.77:0/2948222722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c0a5920 0x7f2c4c071120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0c2d80 tx=0x7f2c4401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe9ac8d64dc1df0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:11.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c4b7fe640 1 -- 172.21.15.77:0/2948222722 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c440a5770 con 0x7f2c4c0a5920 2024-04-25T13:41:11.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c4b7fe640 1 -- 172.21.15.77:0/2948222722 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c440a5910 con 0x7f2c4c0a5920 2024-04-25T13:41:11.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.971+0000 7f2c4b7fe640 1 -- 172.21.15.77:0/2948222722 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c440a5ce0 con 0x7f2c4c0a5920 2024-04-25T13:41:11.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- 172.21.15.77:0/2948222722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c0a5920 msgr2=0x7f2c4c071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2948222722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c0a5920 0x7f2c4c071120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0c2d80 tx=0x7f2c4401c8d0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- 172.21.15.77:0/2948222722 shutdown_connections 2024-04-25T13:41:11.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2948222722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c0a5920 0x7f2c4c071120 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2948222722 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 0x7f2c4c070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2948222722 >> v2:172.21.15.96:3300/0 conn(0x7f2c4c1530d0 0x7f2c4c06eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- 172.21.15.77:0/2948222722 >> 172.21.15.77:0/2948222722 conn(0x7f2c4c0c2180 msgr2=0x7f2c4c0c2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:11.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- 172.21.15.77:0/2948222722 shutdown_connections 2024-04-25T13:41:11.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- 172.21.15.77:0/2948222722 wait complete. 2024-04-25T13:41:11.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 Processor -- start 2024-04-25T13:41:11.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- start start 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 0x7f2c4c1ec1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c4c0a5920 0x7f2c4c0bec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c1530d0 0x7f2c4c0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c156570 con 0x7f2c4c1530d0 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c1563f0 con 0x7f2c4c0a5920 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4c1566f0 con 0x7f2c4c06f0e0 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c51392640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c1530d0 0x7f2c4c0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c51392640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c1530d0 0x7f2c4c0c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42430/0 (socket says 172.21.15.77:42430) 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c51392640 1 -- 172.21.15.77:0/2632591497 learned_addr learned my addr 172.21.15.77:0/2632591497 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c50b91640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 0x7f2c4c1ec1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c4bfff640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c4c0a5920 0x7f2c4c0bec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c51392640 1 -- 172.21.15.77:0/2632591497 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 msgr2=0x7f2c4c1ec1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c51392640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 0x7f2c4c1ec1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c51392640 1 -- 172.21.15.77:0/2632591497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c4c0a5920 msgr2=0x7f2c4c0bec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c51392640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c4c0a5920 0x7f2c4c0bec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c51392640 1 -- 172.21.15.77:0/2632591497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c1eb430 con 0x7f2c4c1530d0 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c51392640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c1530d0 0x7f2c4c0c0440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2c440af040 tx=0x7f2c44019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c497fa640 1 -- 172.21.15.77:0/2632591497 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c440bc020 con 0x7f2c4c1530d0 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c497fa640 1 -- 172.21.15.77:0/2632591497 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c440b88a0 con 0x7f2c4c1530d0 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c1eb6f0 con 0x7f2c4c1530d0 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.975+0000 7f2c497fa640 1 -- 172.21.15.77:0/2632591497 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c44009510 con 0x7f2c4c1530d0 2024-04-25T13:41:11.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.979+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c0bf1c0 con 0x7f2c4c1530d0 2024-04-25T13:41:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.979+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4c06a280 con 0x7f2c4c1530d0 2024-04-25T13:41:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.979+0000 7f2c497fa640 1 -- 172.21.15.77:0/2632591497 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2c440bf020 con 0x7f2c4c1530d0 2024-04-25T13:41:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.979+0000 7f2c497fa640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f2c3806f430 0x7f2c38071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.979+0000 7f2c50b91640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f2c3806f430 0x7f2c38071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:11.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.979+0000 7f2c497fa640 1 -- 172.21.15.77:0/2632591497 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2c4412a3e0 con 0x7f2c4c1530d0 2024-04-25T13:41:11.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.979+0000 7f2c50b91640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f2c3806f430 0x7f2c38071940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c006fd0 tx=0x7f2c3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:11.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:11.983+0000 7f2c497fa640 1 -- 172.21.15.77:0/2632591497 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c440c6030 con 0x7f2c4c1530d0 2024-04-25T13:41:12.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2c4c1ebd40 con 0x7f2c4c1530d0 2024-04-25T13:41:12.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c497fa640 1 -- 172.21.15.77:0/2632591497 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2c440fd040 con 0x7f2c4c1530d0 2024-04-25T13:41:12.168 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:12.168 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T13:41:12.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f2c3806f430 msgr2=0x7f2c38071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f2c3806f430 0x7f2c38071940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c006fd0 tx=0x7f2c3c008040 comp rx=0 tx=0).stop 2024-04-25T13:41:12.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c1530d0 msgr2=0x7f2c4c0c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c1530d0 0x7f2c4c0c0440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2c440af040 tx=0x7f2c44019670 comp rx=0 tx=0).stop 2024-04-25T13:41:12.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 shutdown_connections 2024-04-25T13:41:12.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f2c3806f430 0x7f2c38071940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c4c1530d0 0x7f2c4c0c0440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c4c0a5920 0x7f2c4c0bec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 --2- 172.21.15.77:0/2632591497 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2c4c06f0e0 0x7f2c4c1ec1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 >> 172.21.15.77:0/2632591497 conn(0x7f2c4c0c2180 msgr2=0x7f2c4c06e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:12.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 shutdown_connections 2024-04-25T13:41:12.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.167+0000 7f2c52df5640 1 -- 172.21.15.77:0/2632591497 wait complete. 2024-04-25T13:41:12.188 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T13:41:12.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:12.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.319+0000 7fa07bc7c640 1 Processor -- start 2024-04-25T13:41:12.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.319+0000 7fa07bc7c640 1 -- start start 2024-04-25T13:41:12.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa07bc7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0740b85f0 0x7fa074146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa07bc7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa074071d10 con 0x7fa074073bc0 2024-04-25T13:41:12.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa07bc7c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa074150ff0 con 0x7fa074071900 2024-04-25T13:41:12.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa07bc7c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa0740733c0 con 0x7fa0740b85f0 2024-04-25T13:41:12.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa079a18640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0740b85f0 0x7fa074146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa07a219640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa074073bc0 0x7fa074073fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59052/0 (socket says 172.21.15.77:59052) 2024-04-25T13:41:12.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa07a219640 1 -- 172.21.15.77:0/3935690747 learned_addr learned my addr 172.21.15.77:0/3935690747 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:12.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa079a18640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0740b85f0 0x7fa074146cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42444/0 (socket says 172.21.15.77:42444) 2024-04-25T13:41:12.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa079a18640 1 -- 172.21.15.77:0/3935690747 >> v1:172.21.15.96:6789/0 conn(0x7fa074071900 legacy=0x7fa07406f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:12.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa078a16640 1 -- 172.21.15.77:0/3935690747 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1121723461 0 0) 0x7fa074071d10 con 0x7fa074073bc0 2024-04-25T13:41:12.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa079a18640 1 -- 172.21.15.77:0/3935690747 >> v1:172.21.15.77:6789/0 conn(0x7fa074073bc0 legacy=0x7fa074073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.323+0000 7fa079a18640 1 -- 172.21.15.77:0/3935690747 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0740736a0 con 0x7fa0740b85f0 2024-04-25T13:41:12.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa079a18640 1 --2- 172.21.15.77:0/3935690747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0740b85f0 0x7fa074146cb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa0700097a0 tx=0x7fa07001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff81a0f130f948e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:12.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa078a16640 1 -- 172.21.15.77:0/3935690747 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0700b1070 con 0x7fa0740b85f0 2024-04-25T13:41:12.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa078a16640 1 -- 172.21.15.77:0/3935690747 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0700ac410 con 0x7fa0740b85f0 2024-04-25T13:41:12.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa078a16640 1 -- 172.21.15.77:0/3935690747 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0700ac7e0 con 0x7fa0740b85f0 2024-04-25T13:41:12.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa07bc7c640 1 -- 172.21.15.77:0/3935690747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0740b85f0 msgr2=0x7fa074146cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa07bc7c640 1 --2- 172.21.15.77:0/3935690747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0740b85f0 0x7fa074146cb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa0700097a0 tx=0x7fa07001c390 comp rx=0 tx=0).stop 2024-04-25T13:41:12.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa07bc7c640 1 -- 172.21.15.77:0/3935690747 shutdown_connections 2024-04-25T13:41:12.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa07bc7c640 1 --2- 172.21.15.77:0/3935690747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0740b85f0 0x7fa074146cb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa07bc7c640 1 -- 172.21.15.77:0/3935690747 >> 172.21.15.77:0/3935690747 conn(0x7fa0740c02a0 msgr2=0x7fa0740c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:12.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa07bc7c640 1 -- 172.21.15.77:0/3935690747 shutdown_connections 2024-04-25T13:41:12.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa07bc7c640 1 -- 172.21.15.77:0/3935690747 wait complete. 2024-04-25T13:41:12.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa07bc7c640 1 Processor -- start 2024-04-25T13:41:12.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.327+0000 7fa07bc7c640 1 -- start start 2024-04-25T13:41:12.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07bc7c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa074071900 0x7fa074154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07bc7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa074073bc0 0x7fa074147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07bc7c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0740b85f0 0x7fa0741ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07bc7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa07415eb70 con 0x7fa074073bc0 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07bc7c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa07415e9f0 con 0x7fa0740b85f0 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07bc7c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fa07415ecf0 con 0x7fa074071900 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079217640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa074073bc0 0x7fa074147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079217640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa074073bc0 0x7fa074147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42458/0 (socket says 172.21.15.77:42458) 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079217640 1 -- 172.21.15.77:0/2506078681 learned_addr learned my addr 172.21.15.77:0/2506078681 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079a18640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa074071900 0x7fa074154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07a219640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0740b85f0 0x7fa0741ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079217640 1 -- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa074071900 msgr2=0x7fa074154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079217640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa074071900 0x7fa074154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079217640 1 -- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0740b85f0 msgr2=0x7fa0741ecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079217640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0740b85f0 0x7fa0741ecdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079217640 1 -- 172.21.15.77:0/2506078681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074148e80 con 0x7fa074073bc0 2024-04-25T13:41:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07a219640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0740b85f0 0x7fa0741ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079a18640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa074071900 0x7fa074154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa079217640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa074073bc0 0x7fa074147620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa06400c3a0 tx=0x7fa06400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa06a7fc640 1 -- 172.21.15.77:0/2506078681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640052d0 con 0x7fa074073bc0 2024-04-25T13:41:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa06a7fc640 1 -- 172.21.15.77:0/2506078681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa064005470 con 0x7fa074073bc0 2024-04-25T13:41:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07414a340 con 0x7fa074073bc0 2024-04-25T13:41:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa06a7fc640 1 -- 172.21.15.77:0/2506078681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064007260 con 0x7fa074073bc0 2024-04-25T13:41:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0741526f0 con 0x7fa074073bc0 2024-04-25T13:41:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa07406a280 con 0x7fa074073bc0 2024-04-25T13:41:12.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.331+0000 7fa06a7fc640 1 -- 172.21.15.77:0/2506078681 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa064007400 con 0x7fa074073bc0 2024-04-25T13:41:12.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.335+0000 7fa06a7fc640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa05806f400 0x7fa058071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.335+0000 7fa06a7fc640 1 -- 172.21.15.77:0/2506078681 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa06408e680 con 0x7fa074073bc0 2024-04-25T13:41:12.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.335+0000 7fa079a18640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa05806f400 0x7fa058071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.335+0000 7fa079a18640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa05806f400 0x7fa058071910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa0700ae000 tx=0x7fa070008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:12.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.339+0000 7fa06a7fc640 1 -- 172.21.15.77:0/2506078681 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa06405b600 con 0x7fa074073bc0 2024-04-25T13:41:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.495+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0740742e0 con 0x7fa074073bc0 2024-04-25T13:41:12.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa06a7fc640 1 -- 172.21.15.77:0/2506078681 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7fa06405af00 con 0x7fa074073bc0 2024-04-25T13:41:12.500 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:12.500 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:05.383876+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:12.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa05806f400 msgr2=0x7fa058071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa05806f400 0x7fa058071910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa0700ae000 tx=0x7fa070008040 comp rx=0 tx=0).stop 2024-04-25T13:41:12.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa074073bc0 msgr2=0x7fa074147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa074073bc0 0x7fa074147620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa06400c3a0 tx=0x7fa06400c860 comp rx=0 tx=0).stop 2024-04-25T13:41:12.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 shutdown_connections 2024-04-25T13:41:12.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa05806f400 0x7fa058071910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0740b85f0 0x7fa0741ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa074073bc0 0x7fa074147620 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 --2- 172.21.15.77:0/2506078681 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa074071900 0x7fa074154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 >> 172.21.15.77:0/2506078681 conn(0x7fa0740c02a0 msgr2=0x7fa074144e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:12.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 shutdown_connections 2024-04-25T13:41:12.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.499+0000 7fa07bc7c640 1 -- 172.21.15.77:0/2506078681 wait complete. 2024-04-25T13:41:12.521 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:40:58.420007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:41:01.460651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:41:02.746892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:41:12.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:41:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.655+0000 7fb9bc1d0640 1 Processor -- start 2024-04-25T13:41:12.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.655+0000 7fb9bc1d0640 1 -- start start 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb9b40a5580 0x7fb9b406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb9b406ff10 0x7fb9b40a7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b41535c0 con 0x7fb9b40a7ed0 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b40a3760 con 0x7fb9b406ff10 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b4153090 con 0x7fb9b40a5580 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9ba76d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb9b40a7ed0 0x7fb9b414e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59064/0 (socket says 172.21.15.77:59064) 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9ba76d640 1 -- 172.21.15.77:0/1886787498 learned_addr learned my addr 172.21.15.77:0/1886787498 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b976b640 1 --2- 172.21.15.77:0/1886787498 >> v2:172.21.15.77:3300/0 conn(0x7fb9b406ff10 0x7fb9b40a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b8f6a640 1 -- 172.21.15.77:0/1886787498 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37001416 0 0) 0x7fb9b41535c0 con 0x7fb9b40a7ed0 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b9f6c640 1 --2- 172.21.15.77:0/1886787498 >> v2:172.21.15.96:3300/0 conn(0x7fb9b40a5580 0x7fb9b406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b8f6a640 1 -- 172.21.15.77:0/1886787498 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9a0003530 con 0x7fb9b40a7ed0 2024-04-25T13:41:12.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b976b640 1 -- 172.21.15.77:0/1886787498 >> v2:172.21.15.96:3300/0 conn(0x7fb9b40a5580 msgr2=0x7fb9b406f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:12.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b976b640 1 --2- 172.21.15.77:0/1886787498 >> v2:172.21.15.96:3300/0 conn(0x7fb9b40a5580 0x7fb9b406f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b976b640 1 -- 172.21.15.77:0/1886787498 >> v1:172.21.15.77:6789/0 conn(0x7fb9b40a7ed0 legacy=0x7fb9b414e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b976b640 1 -- 172.21.15.77:0/1886787498 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b40a5990 con 0x7fb9b406ff10 2024-04-25T13:41:12.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b9f6c640 1 --2- 172.21.15.77:0/1886787498 >> v2:172.21.15.96:3300/0 conn(0x7fb9b40a5580 0x7fb9b406f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:12.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b976b640 1 --2- 172.21.15.77:0/1886787498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b406ff10 0x7fb9b40a7990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4070b10 tx=0x7fb9a401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ac4b693c68505b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b8f6a640 1 -- 172.21.15.77:0/1886787498 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40b1070 con 0x7fb9b406ff10 2024-04-25T13:41:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b8f6a640 1 -- 172.21.15.77:0/1886787498 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a40ac620 con 0x7fb9b406ff10 2024-04-25T13:41:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9b8f6a640 1 -- 172.21.15.77:0/1886787498 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40ac9f0 con 0x7fb9b406ff10 2024-04-25T13:41:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/1886787498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b406ff10 msgr2=0x7fb9b40a7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 --2- 172.21.15.77:0/1886787498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b406ff10 0x7fb9b40a7990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4070b10 tx=0x7fb9a401c3c0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/1886787498 shutdown_connections 2024-04-25T13:41:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 --2- 172.21.15.77:0/1886787498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b406ff10 0x7fb9b40a7990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 --2- 172.21.15.77:0/1886787498 >> v2:172.21.15.96:3300/0 conn(0x7fb9b40a5580 0x7fb9b406f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/1886787498 >> 172.21.15.77:0/1886787498 conn(0x7fb9b40c3cd0 msgr2=0x7fb9b40c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/1886787498 shutdown_connections 2024-04-25T13:41:12.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.659+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/1886787498 wait complete. 2024-04-25T13:41:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 Processor -- start 2024-04-25T13:41:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 -- start start 2024-04-25T13:41:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9b40a5580 0x7fb9b4143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b40a7ed0 0x7fb9b414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b414c670 0x7fb9b41e9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b415a200 con 0x7fb9b414c670 2024-04-25T13:41:12.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b40a87b0 con 0x7fb9b40a7ed0 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b415a380 con 0x7fb9b40a5580 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9ba76d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b414c670 0x7fb9b41e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9ba76d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b414c670 0x7fb9b41e9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42482/0 (socket says 172.21.15.77:42482) 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9ba76d640 1 -- 172.21.15.77:0/2218005180 learned_addr learned my addr 172.21.15.77:0/2218005180 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9b9f6c640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9b40a5580 0x7fb9b4143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9ba76d640 1 -- 172.21.15.77:0/2218005180 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9b40a5580 msgr2=0x7fb9b4143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9ba76d640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9b40a5580 0x7fb9b4143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9ba76d640 1 -- 172.21.15.77:0/2218005180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b40a7ed0 msgr2=0x7fb9b414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9ba76d640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b40a7ed0 0x7fb9b414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9ba76d640 1 -- 172.21.15.77:0/2218005180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b41ed2e0 con 0x7fb9b414c670 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9ba76d640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b414c670 0x7fb9b41e9560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00caa0 tx=0x7fb9ac00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9aa7fc640 1 -- 172.21.15.77:0/2218005180 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac017070 con 0x7fb9b414c670 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9aa7fc640 1 -- 172.21.15.77:0/2218005180 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac00ac00 con 0x7fb9b414c670 2024-04-25T13:41:12.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b4143970 con 0x7fb9b414c670 2024-04-25T13:41:12.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9aa7fc640 1 -- 172.21.15.77:0/2218005180 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac012400 con 0x7fb9b414c670 2024-04-25T13:41:12.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.663+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b41ed000 con 0x7fb9b414c670 2024-04-25T13:41:12.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.667+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b406a1a0 con 0x7fb9b414c670 2024-04-25T13:41:12.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.667+0000 7fb9aa7fc640 1 -- 172.21.15.77:0/2218005180 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb9ac01a070 con 0x7fb9b414c670 2024-04-25T13:41:12.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.667+0000 7fb9aa7fc640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb99806f430 0x7fb998071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.667+0000 7fb9b9f6c640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb99806f430 0x7fb998071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.667+0000 7fb9aa7fc640 1 -- 172.21.15.77:0/2218005180 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9ac08eeb0 con 0x7fb9b414c670 2024-04-25T13:41:12.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.667+0000 7fb9b9f6c640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb99806f430 0x7fb998071940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0006fd0 tx=0x7fb9b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:12.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.671+0000 7fb9aa7fc640 1 -- 172.21.15.77:0/2218005180 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb9ac05b750 con 0x7fb9b414c670 2024-04-25T13:41:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.819+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb9b40a7b80 con 0x7fb9b414c670 2024-04-25T13:41:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.819+0000 7fb9aa7fc640 1 -- 172.21.15.77:0/2218005180 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fb9ac05fa50 con 0x7fb9b414c670 2024-04-25T13:41:12.822 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T13:41:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb99806f430 msgr2=0x7fb998071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb99806f430 0x7fb998071940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0006fd0 tx=0x7fb9b0008040 comp rx=0 tx=0).stop 2024-04-25T13:41:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b414c670 msgr2=0x7fb9b41e9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b414c670 0x7fb9b41e9560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00caa0 tx=0x7fb9ac00cf60 comp rx=0 tx=0).stop 2024-04-25T13:41:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 shutdown_connections 2024-04-25T13:41:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb99806f430 0x7fb998071940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b414c670 0x7fb9b41e9560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b40a7ed0 0x7fb9b414c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 --2- 172.21.15.77:0/2218005180 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9b40a5580 0x7fb9b4143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 >> 172.21.15.77:0/2218005180 conn(0x7fb9b40c3cd0 msgr2=0x7fb9b40c1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 shutdown_connections 2024-04-25T13:41:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.823+0000 7fb9bc1d0640 1 -- 172.21.15.77:0/2218005180 wait complete. 2024-04-25T13:41:12.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:41:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe52547c640 1 Processor -- start 2024-04-25T13:41:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe52547c640 1 -- start start 2024-04-25T13:41:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe52547c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe52014fe10 0x7fe520072e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe52547c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 0x7fe5200737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe52547c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5200741b0 con 0x7fe52006fba0 2024-04-25T13:41:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe52547c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe520071b10 con 0x7fe52014fe10 2024-04-25T13:41:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe52547c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe5200bfe40 con 0x7fe5200733d0 2024-04-25T13:41:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51e7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe52014fe10 0x7fe520072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe52006fba0 0x7fe52014f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59076/0 (socket says 172.21.15.77:59076) 2024-04-25T13:41:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51e7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe52014fe10 0x7fe520072e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42488/0 (socket says 172.21.15.77:42488) 2024-04-25T13:41:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51effd640 1 -- 172.21.15.77:0/3110021965 learned_addr learned my addr 172.21.15.77:0/3110021965 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51f7fe640 1 --2- 172.21.15.77:0/3110021965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 0x7fe5200737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51e7fc640 1 -- 172.21.15.77:0/3110021965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 msgr2=0x7fe5200737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51e7fc640 1 --2- 172.21.15.77:0/3110021965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 0x7fe5200737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51e7fc640 1 -- 172.21.15.77:0/3110021965 >> v1:172.21.15.77:6789/0 conn(0x7fe52006fba0 legacy=0x7fe52014f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51e7fc640 1 -- 172.21.15.77:0/3110021965 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe520073d20 con 0x7fe52014fe10 2024-04-25T13:41:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.987+0000 7fe51dffb640 1 -- 172.21.15.77:0/3110021965 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354445234 0 0) 0x7fe5200741b0 con 0x7fe52006fba0 2024-04-25T13:41:12.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe51e7fc640 1 --2- 172.21.15.77:0/3110021965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 0x7fe520072e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe5140097c0 tx=0x7fe51401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fe2fc03be9c30d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:12.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe51dffb640 1 -- 172.21.15.77:0/3110021965 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5140b0070 con 0x7fe52014fe10 2024-04-25T13:41:12.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe51dffb640 1 -- 172.21.15.77:0/3110021965 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5140ab600 con 0x7fe52014fe10 2024-04-25T13:41:12.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe51dffb640 1 -- 172.21.15.77:0/3110021965 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5140ab9d0 con 0x7fe52014fe10 2024-04-25T13:41:12.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe52547c640 1 -- 172.21.15.77:0/3110021965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 msgr2=0x7fe520072e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe52547c640 1 --2- 172.21.15.77:0/3110021965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 0x7fe520072e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe5140097c0 tx=0x7fe51401c410 comp rx=0 tx=0).stop 2024-04-25T13:41:12.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe52547c640 1 -- 172.21.15.77:0/3110021965 shutdown_connections 2024-04-25T13:41:12.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe52547c640 1 --2- 172.21.15.77:0/3110021965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 0x7fe5200737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe52547c640 1 --2- 172.21.15.77:0/3110021965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 0x7fe520072e90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe52547c640 1 -- 172.21.15.77:0/3110021965 >> 172.21.15.77:0/3110021965 conn(0x7fe5200c3cd0 msgr2=0x7fe5200c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:12.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe52547c640 1 -- 172.21.15.77:0/3110021965 shutdown_connections 2024-04-25T13:41:12.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.991+0000 7fe52547c640 1 -- 172.21.15.77:0/3110021965 wait complete. 2024-04-25T13:41:12.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 Processor -- start 2024-04-25T13:41:12.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 -- start start 2024-04-25T13:41:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe52006fba0 0x7fe520147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 0x7fe5201ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 0x7fe5201ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5200a8cc0 con 0x7fe52014fe10 2024-04-25T13:41:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe52015d630 con 0x7fe52006fba0 2024-04-25T13:41:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe52015d7b0 con 0x7fe5200733d0 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 0x7fe5201ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 0x7fe5201ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42490/0 (socket says 172.21.15.77:42490) 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51f7fe640 1 -- 172.21.15.77:0/1734673299 learned_addr learned my addr 172.21.15.77:0/1734673299 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51effd640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe52006fba0 0x7fe520147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51e7fc640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 0x7fe5201ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51f7fe640 1 -- 172.21.15.77:0/1734673299 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 msgr2=0x7fe5201ed0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51f7fe640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 0x7fe5201ed0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51f7fe640 1 -- 172.21.15.77:0/1734673299 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe52006fba0 msgr2=0x7fe520147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51f7fe640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe52006fba0 0x7fe520147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51f7fe640 1 -- 172.21.15.77:0/1734673299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5201460e0 con 0x7fe52014fe10 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe51f7fe640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 0x7fe5201ed5f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe518007e60 tx=0x7fe51800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe5077fe640 1 -- 172.21.15.77:0/1734673299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518014420 con 0x7fe52014fe10 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe5077fe640 1 -- 172.21.15.77:0/1734673299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe518019070 con 0x7fe52014fe10 2024-04-25T13:41:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5201ecb90 con 0x7fe52014fe10 2024-04-25T13:41:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe5077fe640 1 -- 172.21.15.77:0/1734673299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518014820 con 0x7fe52014fe10 2024-04-25T13:41:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5201421b0 con 0x7fe52014fe10 2024-04-25T13:41:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe52006a1a0 con 0x7fe52014fe10 2024-04-25T13:41:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.995+0000 7fe5077fe640 1 -- 172.21.15.77:0/1734673299 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe5180149c0 con 0x7fe52014fe10 2024-04-25T13:41:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.999+0000 7fe5077fe640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe50c06f400 0x7fe50c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.999+0000 7fe51effd640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe50c06f400 0x7fe50c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.999+0000 7fe5077fe640 1 -- 172.21.15.77:0/1734673299 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe51808fb00 con 0x7fe52014fe10 2024-04-25T13:41:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:12.999+0000 7fe51effd640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe50c06f400 0x7fe50c071910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe510000f70 tx=0x7fe510009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:13.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.003+0000 7fe5077fe640 1 -- 172.21.15.77:0/1734673299 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe51805c430 con 0x7fe52014fe10 2024-04-25T13:41:13.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.163+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe5200c2990 con 0x7fe52014fe10 2024-04-25T13:41:13.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe5077fe640 1 -- 172.21.15.77:0/1734673299 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fe518060730 con 0x7fe52014fe10 2024-04-25T13:41:13.167 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T13:41:13.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe50c06f400 msgr2=0x7fe50c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe50c06f400 0x7fe50c071910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe510000f70 tx=0x7fe510009040 comp rx=0 tx=0).stop 2024-04-25T13:41:13.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 msgr2=0x7fe5201ed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 0x7fe5201ed5f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe518007e60 tx=0x7fe51800e4b0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 shutdown_connections 2024-04-25T13:41:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe50c06f400 0x7fe50c071910 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe52014fe10 0x7fe5201ed5f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5200733d0 0x7fe5201ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 --2- 172.21.15.77:0/1734673299 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe52006fba0 0x7fe520147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 >> 172.21.15.77:0/1734673299 conn(0x7fe5200c3cd0 msgr2=0x7fe520150360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 shutdown_connections 2024-04-25T13:41:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.167+0000 7fe52547c640 1 -- 172.21.15.77:0/1734673299 wait complete. 2024-04-25T13:41:13.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:41:13.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f533d90c640 1 Processor -- start 2024-04-25T13:41:13.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f533d90c640 1 -- start start 2024-04-25T13:41:13.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f533d90c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f533806f9d0 0x7f533806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f533d90c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f533814eb20 0x7f53380a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f533d90c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53380a31d0 con 0x7f533814e710 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f533d90c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f53380a34d0 con 0x7f533806f9d0 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f533d90c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f53381534e0 con 0x7f533814eb20 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f532e7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f533814e710 0x7f53380a7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59084/0 (socket says 172.21.15.77:59084) 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f532e7fc640 1 -- 172.21.15.77:0/271365974 learned_addr learned my addr 172.21.15.77:0/271365974 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f5336ffd640 1 --2- 172.21.15.77:0/271365974 >> v2:172.21.15.96:3300/0 conn(0x7f533806f9d0 0x7f533806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53377fe640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f533814eb20 0x7f53380a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315119872 0 0) 0x7f53380a31d0 con 0x7f533814e710 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5324003530 con 0x7f533814e710 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 441420355 0 0) 0x7f5324003530 con 0x7f533814e710 2024-04-25T13:41:13.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f533814eb20 msgr2=0x7f53380a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f533814eb20 0x7f53380a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 >> v2:172.21.15.96:3300/0 conn(0x7f533806f9d0 msgr2=0x7f533806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 --2- 172.21.15.77:0/271365974 >> v2:172.21.15.96:3300/0 conn(0x7f533806f9d0 0x7f533806fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533814ef30 con 0x7f533814e710 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f5320001680 con 0x7f533814e710 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 >> v1:172.21.15.77:6789/0 conn(0x7f533814e710 legacy=0x7f53380a7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f533814eb20 0x7f5324003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5324003fb0 0x7f5324004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5324004d50 0x7f5324005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53380a34d0 con 0x7f5324003fb0 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f53381534e0 con 0x7f5324004d50 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f532400bab0 con 0x7f533814eb20 2024-04-25T13:41:13.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f532e7fc640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5324003fb0 0x7f5324004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f53377fe640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5324004d50 0x7f5324005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f532e7fc640 1 -- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f533814eb20 msgr2=0x7f5324003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:13.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f532e7fc640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f533814eb20 0x7f5324003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f532e7fc640 1 -- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5324004d50 msgr2=0x7f5324005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:13.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f532e7fc640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5324004d50 0x7f5324005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.343+0000 7f532e7fc640 1 -- 172.21.15.77:0/271365974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5324003530 con 0x7f5324003fb0 2024-04-25T13:41:13.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f532e7fc640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5324003fb0 0x7f5324004810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5320001060 tx=0x7f532001f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403ec38e3037798b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:13.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320007d80 con 0x7f5324003fb0 2024-04-25T13:41:13.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5320005b00 con 0x7f5324003fb0 2024-04-25T13:41:13.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f53367fc640 1 -- 172.21.15.77:0/271365974 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320007070 con 0x7f5324003fb0 2024-04-25T13:41:13.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f533d90c640 1 -- 172.21.15.77:0/271365974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5324003fb0 msgr2=0x7f5324004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f533d90c640 1 --2- 172.21.15.77:0/271365974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5324003fb0 0x7f5324004810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5320001060 tx=0x7f532001f410 comp rx=0 tx=0).stop 2024-04-25T13:41:13.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f53377fe640 1 -- 172.21.15.77:0/271365974 reap_dead start 2024-04-25T13:41:13.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f533d90c640 1 -- 172.21.15.77:0/271365974 shutdown_connections 2024-04-25T13:41:13.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f533d90c640 1 -- 172.21.15.77:0/271365974 >> 172.21.15.77:0/271365974 conn(0x7f53380c3cd0 msgr2=0x7f53380c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:13.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f533d90c640 1 -- 172.21.15.77:0/271365974 shutdown_connections 2024-04-25T13:41:13.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.347+0000 7f533d90c640 1 -- 172.21.15.77:0/271365974 wait complete. 2024-04-25T13:41:13.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 Processor -- start 2024-04-25T13:41:13.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 -- start start 2024-04-25T13:41:13.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5324003fb0 0x7f53380a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53380a6dc0 0x7f53380a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53380732c0 0x7f53381ebd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5338153210 con 0x7f53380732c0 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5338153090 con 0x7f53380a6dc0 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f53380a80a0 con 0x7f5324003fb0 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f53377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53380732c0 0x7f53381ebd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f53377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53380732c0 0x7f53381ebd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42504/0 (socket says 172.21.15.77:42504) 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f53377fe640 1 -- 172.21.15.77:0/3090255605 learned_addr learned my addr 172.21.15.77:0/3090255605 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f5336ffd640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5324003fb0 0x7f53380a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f532e7fc640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53380a6dc0 0x7f53380a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f53377fe640 1 -- 172.21.15.77:0/3090255605 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5324003fb0 msgr2=0x7f53380a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f53377fe640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5324003fb0 0x7f53380a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f53377fe640 1 -- 172.21.15.77:0/3090255605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53380a6dc0 msgr2=0x7f53380a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f53377fe640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53380a6dc0 0x7f53380a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f53377fe640 1 -- 172.21.15.77:0/3090255605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53381ecaa0 con 0x7f53380732c0 2024-04-25T13:41:13.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f53377fe640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53380732c0 0x7f53381ebd30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5338070b10 tx=0x7f533000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:13.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f5334ff9640 1 -- 172.21.15.77:0/3090255605 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533001c070 con 0x7f53380732c0 2024-04-25T13:41:13.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f5334ff9640 1 -- 172.21.15.77:0/3090255605 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5330017400 con 0x7f53380732c0 2024-04-25T13:41:13.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53380737e0 con 0x7f53380732c0 2024-04-25T13:41:13.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f5334ff9640 1 -- 172.21.15.77:0/3090255605 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53300177f0 con 0x7f53380732c0 2024-04-25T13:41:13.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5338072a40 con 0x7f53380732c0 2024-04-25T13:41:13.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.351+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533806a1a0 con 0x7f53380732c0 2024-04-25T13:41:13.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.355+0000 7f5334ff9640 1 -- 172.21.15.77:0/3090255605 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f533001f070 con 0x7f53380732c0 2024-04-25T13:41:13.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.355+0000 7f5334ff9640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f531806f430 0x7f5318071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.355+0000 7f5336ffd640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f531806f430 0x7f5318071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.355+0000 7f5334ff9640 1 -- 172.21.15.77:0/3090255605 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f533008f650 con 0x7f53380732c0 2024-04-25T13:41:13.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.355+0000 7f5336ffd640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f531806f430 0x7f5318071940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f53280047c0 tx=0x7f5328008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:13.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.359+0000 7f5334ff9640 1 -- 172.21.15.77:0/3090255605 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5330012070 con 0x7f53380732c0 2024-04-25T13:41:13.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.507+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f533814e350 con 0x7f53380732c0 2024-04-25T13:41:13.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.507+0000 7f5334ff9640 1 -- 172.21.15.77:0/3090255605 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f533005bfd0 con 0x7f53380732c0 2024-04-25T13:41:13.510 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T13:41:13.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f531806f430 msgr2=0x7f5318071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f531806f430 0x7f5318071940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f53280047c0 tx=0x7f5328008040 comp rx=0 tx=0).stop 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53380732c0 msgr2=0x7f53381ebd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53380732c0 0x7f53381ebd30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5338070b10 tx=0x7f533000f4a0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 shutdown_connections 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f531806f430 0x7f5318071940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53380732c0 0x7f53381ebd30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53380a6dc0 0x7f53380a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 --2- 172.21.15.77:0/3090255605 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5324003fb0 0x7f53380a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 >> 172.21.15.77:0/3090255605 conn(0x7f53380c3cd0 msgr2=0x7f53380c1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 shutdown_connections 2024-04-25T13:41:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.511+0000 7f533d90c640 1 -- 172.21.15.77:0/3090255605 wait complete. 2024-04-25T13:41:13.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:13.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a41d6640 1 Processor -- start 2024-04-25T13:41:13.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a41d6640 1 -- start start 2024-04-25T13:41:13.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a41d6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c151e30 0x7f119c152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a41d6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f119c156310 con 0x7f119c06c780 2024-04-25T13:41:13.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a41d6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f119c1565b0 con 0x7f119c1529a0 2024-04-25T13:41:13.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a41d6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f119c0a61a0 con 0x7f119c151e30 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a1f72640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f119c06c780 0x7f119c151720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59094/0 (socket says 172.21.15.77:59094) 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a1f72640 1 -- 172.21.15.77:0/2719251019 learned_addr learned my addr 172.21.15.77:0/2719251019 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a1771640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c151e30 0x7f119c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782072832 0 0) 0x7f119c156310 con 0x7f119c06c780 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1188003530 con 0x7f119c06c780 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1168192750 0 0) 0x7f1188003530 con 0x7f119c06c780 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c151e30 msgr2=0x7f119c152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c151e30 0x7f119c152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 >> v1:172.21.15.96:6789/0 conn(0x7f119c1529a0 legacy=0x7f119c152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c0748e0 con 0x7f119c06c780 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f11940016a0 con 0x7f119c06c780 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 >> v1:172.21.15.77:6789/0 conn(0x7f119c06c780 legacy=0x7f119c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f1188003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c151e30 0x7f1188004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1188004d50 0x7f11880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0a61a0 con 0x7f11880039f0 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f118800bb60 con 0x7f1188004d50 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f118800bd60 con 0x7f119c151e30 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.663+0000 7f11a1f72640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f1188003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a2773640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1188004d50 0x7f11880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a1f72640 1 -- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c151e30 msgr2=0x7f1188004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a1f72640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c151e30 0x7f1188004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a1f72640 1 -- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1188004d50 msgr2=0x7f11880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a1f72640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1188004d50 0x7f11880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a1f72640 1 -- 172.21.15.77:0/2719251019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1188003530 con 0x7f11880039f0 2024-04-25T13:41:13.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a2773640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1188004d50 0x7f11880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:13.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a1f72640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f1188003e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f119c1564e0 tx=0x7f119401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de630ce0f83c50a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:13.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194007c90 con 0x7f11880039f0 2024-04-25T13:41:13.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11940a9070 con 0x7f11880039f0 2024-04-25T13:41:13.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a0f70640 1 -- 172.21.15.77:0/2719251019 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194005d40 con 0x7f11880039f0 2024-04-25T13:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a41d6640 1 -- 172.21.15.77:0/2719251019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 msgr2=0x7f1188003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.667+0000 7f11a41d6640 1 --2- 172.21.15.77:0/2719251019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f1188003e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f119c1564e0 tx=0x7f119401cba0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a2773640 1 -- 172.21.15.77:0/2719251019 reap_dead start 2024-04-25T13:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- 172.21.15.77:0/2719251019 shutdown_connections 2024-04-25T13:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- 172.21.15.77:0/2719251019 >> 172.21.15.77:0/2719251019 conn(0x7f119c0c4650 msgr2=0x7f119c0c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- 172.21.15.77:0/2719251019 shutdown_connections 2024-04-25T13:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- 172.21.15.77:0/2719251019 wait complete. 2024-04-25T13:41:13.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 Processor -- start 2024-04-25T13:41:13.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- start start 2024-04-25T13:41:13.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f119c1ef000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c1ec340 0x7f119c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c15c180 0x7f119c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0a5f20 con 0x7f11880039f0 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f119c15e620 con 0x7f119c15c180 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f119c15e7a0 con 0x7f119c1ec340 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a1f72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f119c1ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a1f72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f119c1ef000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42516/0 (socket says 172.21.15.77:42516) 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a1f72640 1 -- 172.21.15.77:0/2063126575 learned_addr learned my addr 172.21.15.77:0/2063126575 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a1f72640 1 -- 172.21.15.77:0/2063126575 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c1ec340 msgr2=0x7f119c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a1f72640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c1ec340 0x7f119c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a1f72640 1 -- 172.21.15.77:0/2063126575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c15c180 msgr2=0x7f119c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a2773640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c15c180 0x7f119c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a1f72640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c15c180 0x7f119c14cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a1f72640 1 -- 172.21.15.77:0/2063126575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c15d300 con 0x7f11880039f0 2024-04-25T13:41:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a1f72640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f119c1ef000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1194000c10 tx=0x7f1188005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f118e7fc640 1 -- 172.21.15.77:0/2063126575 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11940047f0 con 0x7f11880039f0 2024-04-25T13:41:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f118e7fc640 1 -- 172.21.15.77:0/2063126575 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1194004990 con 0x7f11880039f0 2024-04-25T13:41:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f118e7fc640 1 -- 172.21.15.77:0/2063126575 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194004d60 con 0x7f11880039f0 2024-04-25T13:41:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c1eca40 con 0x7f11880039f0 2024-04-25T13:41:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.671+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c1ef8c0 con 0x7f11880039f0 2024-04-25T13:41:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.675+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119c06a280 con 0x7f11880039f0 2024-04-25T13:41:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.675+0000 7f118e7fc640 1 -- 172.21.15.77:0/2063126575 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f11940a5790 con 0x7f11880039f0 2024-04-25T13:41:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.675+0000 7f118e7fc640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f118006f430 0x7f1180071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.675+0000 7f118e7fc640 1 -- 172.21.15.77:0/2063126575 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1194128af0 con 0x7f11880039f0 2024-04-25T13:41:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.675+0000 7f11a1771640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f118006f430 0x7f1180071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.675+0000 7f11a1771640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f118006f430 0x7f1180071940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1190009670 tx=0x7f119000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:13.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.679+0000 7f118e7fc640 1 -- 172.21.15.77:0/2063126575 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f11940168b0 con 0x7f11880039f0 2024-04-25T13:41:13.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.863+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f119c0c31b0 con 0x7f11880039f0 2024-04-25T13:41:13.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f118e7fc640 1 -- 172.21.15.77:0/2063126575 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7f11940f5be0 con 0x7f11880039f0 2024-04-25T13:41:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:13.867 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2393103049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2393103049},{"type":"v1","addr":"172.21.15.77:6835","nonce":2393103049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:41:03.799479+0000","modified":"2024-04-25T13:41:06.824136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6833/1035589958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":1035589958},{"type":"v1","addr":"172.21.15.96:6833","nonce":1035589958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-25T13:41:13.867 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-04-25T13:41:13.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f118006f430 msgr2=0x7f1180071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f118006f430 0x7f1180071940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1190009670 tx=0x7f119000d040 comp rx=0 tx=0).stop 2024-04-25T13:41:13.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 msgr2=0x7f119c1ef000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f119c1ef000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1194000c10 tx=0x7f1188005840 comp rx=0 tx=0).stop 2024-04-25T13:41:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 shutdown_connections 2024-04-25T13:41:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f118006f430 0x7f1180071940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119c15c180 0x7f119c14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f119c1ec340 0x7f119c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 --2- 172.21.15.77:0/2063126575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11880039f0 0x7f119c1ef000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 >> 172.21.15.77:0/2063126575 conn(0x7f119c0c4650 msgr2=0x7f119c14e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 shutdown_connections 2024-04-25T13:41:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:13.867+0000 7f11a41d6640 1 -- 172.21.15.77:0/2063126575 wait complete. 2024-04-25T13:41:13.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:14.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f559dc32640 1 Processor -- start 2024-04-25T13:41:14.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f559dc32640 1 -- start start 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f559dc32640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980a8eb0 0x7f559806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f559dc32640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55980a7890 con 0x7f5598074360 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f559dc32640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55980a92c0 con 0x7f5598073730 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f559dc32640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f55980a7ea0 con 0x7f55980a8eb0 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55977fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5598074360 0x7f5598152dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59108/0 (socket says 172.21.15.77:59108) 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55977fe640 1 -- 172.21.15.77:0/2717661623 learned_addr learned my addr 172.21.15.77:0/2717661623 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f5596ffd640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980a8eb0 0x7f559806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236830418 0 0) 0x7f55980a7890 con 0x7f5598074360 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5580003530 con 0x7f5598074360 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4196512221 0 0) 0x7f5580003530 con 0x7f5598074360 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980a8eb0 msgr2=0x7f559806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980a8eb0 0x7f559806c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 >> v1:172.21.15.96:6789/0 conn(0x7f5598073730 legacy=0x7f5598073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55980a7b30 con 0x7f5598074360 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f5588001680 con 0x7f5598074360 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 >> v1:172.21.15.77:6789/0 conn(0x7f5598074360 legacy=0x7f5598152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55800039f0 0x7f5580003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5580004810 0x7f5580004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980a8eb0 0x7f55800052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f55980a7ea0 con 0x7f55800039f0 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f558000bb90 con 0x7f5580004810 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f558000bd90 con 0x7f55980a8eb0 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55977fe640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55800039f0 0x7f5580003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f5596ffd640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5580004810 0x7f5580004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f5597fff640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980a8eb0 0x7f55800052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55977fe640 1 -- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980a8eb0 msgr2=0x7f55800052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55977fe640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980a8eb0 0x7f55800052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55977fe640 1 -- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5580004810 msgr2=0x7f5580004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:14.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55977fe640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5580004810 0x7f5580004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f55977fe640 1 -- 172.21.15.77:0/2717661623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5580003530 con 0x7f55800039f0 2024-04-25T13:41:14.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f5597fff640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55980a8eb0 0x7f55800052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:14.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.031+0000 7f5596ffd640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5580004810 0x7f5580004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f55977fe640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55800039f0 0x7f5580003e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5598072960 tx=0x7f558801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8417c5f0592b5a69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588007d20 con 0x7f55800039f0 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55880a9070 con 0x7f55800039f0 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f55967fc640 1 -- 172.21.15.77:0/2717661623 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588005d60 con 0x7f55800039f0 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f559dc32640 1 -- 172.21.15.77:0/2717661623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55800039f0 msgr2=0x7f5580003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f559dc32640 1 --2- 172.21.15.77:0/2717661623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55800039f0 0x7f5580003e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5598072960 tx=0x7f558801cc20 comp rx=0 tx=0).stop 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f5597fff640 1 -- 172.21.15.77:0/2717661623 reap_dead start 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f559dc32640 1 -- 172.21.15.77:0/2717661623 shutdown_connections 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f559dc32640 1 -- 172.21.15.77:0/2717661623 >> 172.21.15.77:0/2717661623 conn(0x7f55980c46e0 msgr2=0x7f55980c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f559dc32640 1 -- 172.21.15.77:0/2717661623 shutdown_connections 2024-04-25T13:41:14.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.035+0000 7f559dc32640 1 -- 172.21.15.77:0/2717661623 wait complete. 2024-04-25T13:41:14.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 Processor -- start 2024-04-25T13:41:14.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 -- start start 2024-04-25T13:41:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55800039f0 0x7f55981ec550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55980a4ff0 0x7f55980bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980be210 0x7f559814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f559815e6f0 con 0x7f55980a4ff0 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f559815e570 con 0x7f55980be210 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f559815e870 con 0x7f55800039f0 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5596ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55980a4ff0 0x7f55980bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5596ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55980a4ff0 0x7f55980bf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42532/0 (socket says 172.21.15.77:42532) 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5596ffd640 1 -- 172.21.15.77:0/3764069138 learned_addr learned my addr 172.21.15.77:0/3764069138 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f55977fe640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55800039f0 0x7f55981ec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5597fff640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980be210 0x7f559814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5596ffd640 1 -- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55800039f0 msgr2=0x7f55981ec550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5596ffd640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55800039f0 0x7f55981ec550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5596ffd640 1 -- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980be210 msgr2=0x7f559814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5596ffd640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980be210 0x7f559814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5596ffd640 1 -- 172.21.15.77:0/3764069138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55981ebd50 con 0x7f55980a4ff0 2024-04-25T13:41:14.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f55977fe640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55800039f0 0x7f55981ec550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5597fff640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980be210 0x7f559814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f5596ffd640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55980a4ff0 0x7f55980bf8e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f558c010900 tx=0x7f558c010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f557ffff640 1 -- 172.21.15.77:0/3764069138 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c00f040 con 0x7f55980a4ff0 2024-04-25T13:41:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f557ffff640 1 -- 172.21.15.77:0/3764069138 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558c00ec20 con 0x7f55980a4ff0 2024-04-25T13:41:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55980bfe20 con 0x7f55980a4ff0 2024-04-25T13:41:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f557ffff640 1 -- 172.21.15.77:0/3764069138 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c004020 con 0x7f55980a4ff0 2024-04-25T13:41:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55981eb980 con 0x7f55980a4ff0 2024-04-25T13:41:14.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55981ec180 con 0x7f55980a4ff0 2024-04-25T13:41:14.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.039+0000 7f557ffff640 1 -- 172.21.15.77:0/3764069138 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f558c0041c0 con 0x7f55980a4ff0 2024-04-25T13:41:14.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.043+0000 7f557ffff640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f558406f400 0x7f5584071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.043+0000 7f557ffff640 1 -- 172.21.15.77:0/3764069138 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f558c08f980 con 0x7f55980a4ff0 2024-04-25T13:41:14.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.043+0000 7f55977fe640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f558406f400 0x7f5584071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.043+0000 7f55977fe640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f558406f400 0x7f5584071910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f55880ab000 tx=0x7f55880a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:14.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.047+0000 7f557ffff640 1 -- 172.21.15.77:0/3764069138 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f558c018030 con 0x7f55980a4ff0 2024-04-25T13:41:14.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.195+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f559806a280 con 0x7f55980a4ff0 2024-04-25T13:41:14.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.195+0000 7f557ffff640 1 -- 172.21.15.77:0/3764069138 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7f558c05c900 con 0x7f55980a4ff0 2024-04-25T13:41:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:14.199 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:05.383876+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f558406f400 msgr2=0x7f5584071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f558406f400 0x7f5584071910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f55880ab000 tx=0x7f55880a7070 comp rx=0 tx=0).stop 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55980a4ff0 msgr2=0x7f55980bf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55980a4ff0 0x7f55980bf8e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f558c010900 tx=0x7f558c010dc0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 shutdown_connections 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f558406f400 0x7f5584071910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55980be210 0x7f559814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55980a4ff0 0x7f55980bf8e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 --2- 172.21.15.77:0/3764069138 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f55800039f0 0x7f55981ec550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 >> 172.21.15.77:0/3764069138 conn(0x7f55980c46e0 msgr2=0x7f55980756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 shutdown_connections 2024-04-25T13:41:14.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.199+0000 7f559dc32640 1 -- 172.21.15.77:0/3764069138 wait complete. 2024-04-25T13:41:14.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:40:58.420007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:41:01.460651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:41:02.746892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:41:14.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:41:14.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f838c022640 1 Processor -- start 2024-04-25T13:41:14.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f838c022640 1 -- start start 2024-04-25T13:41:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f838c022640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 0x7f838406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f838c022640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f83840a6870 0x7f83840a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f838c022640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f83840c1ee0 0x7f83840c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f838c022640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8384153480 con 0x7f83840a6870 2024-04-25T13:41:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f838c022640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f83840a71c0 con 0x7f83840c1ee0 2024-04-25T13:41:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f838c022640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f83841529a0 con 0x7f83840c69b0 2024-04-25T13:41:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f83895bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f83840a6870 0x7f83840a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f83895bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f83840a6870 0x7f83840a6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42548/0 (socket says 172.21.15.77:42548) 2024-04-25T13:41:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f83895bd640 1 -- 172.21.15.77:0/3515911652 learned_addr learned my addr 172.21.15.77:0/3515911652 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f838a5bf640 1 --2- 172.21.15.77:0/3515911652 >> v2:172.21.15.96:3300/0 conn(0x7f83840c1ee0 0x7f83840c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f8389dbe640 1 --2- 172.21.15.77:0/3515911652 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 0x7f838406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f83895bd640 1 -- 172.21.15.77:0/3515911652 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 msgr2=0x7f838406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f83895bd640 1 --2- 172.21.15.77:0/3515911652 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 0x7f838406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f83895bd640 1 -- 172.21.15.77:0/3515911652 >> v2:172.21.15.96:3300/0 conn(0x7f83840c1ee0 msgr2=0x7f83840c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f83895bd640 1 --2- 172.21.15.77:0/3515911652 >> v2:172.21.15.96:3300/0 conn(0x7f83840c1ee0 0x7f83840c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.371+0000 7f83895bd640 1 -- 172.21.15.77:0/3515911652 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8384152c80 con 0x7f83840a6870 2024-04-25T13:41:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f83895bd640 1 --2- 172.21.15.77:0/3515911652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840a6870 0x7f83840a6c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f838408d570 tx=0x7f838001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be70862ca132a08b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f8388dbc640 1 -- 172.21.15.77:0/3515911652 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83800b1070 con 0x7f83840a6870 2024-04-25T13:41:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f8388dbc640 1 -- 172.21.15.77:0/3515911652 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83800a8050 con 0x7f83840a6870 2024-04-25T13:41:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f8388dbc640 1 -- 172.21.15.77:0/3515911652 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83800ac860 con 0x7f83840a6870 2024-04-25T13:41:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f838c022640 1 -- 172.21.15.77:0/3515911652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840a6870 msgr2=0x7f83840a6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f838c022640 1 --2- 172.21.15.77:0/3515911652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840a6870 0x7f83840a6c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f838408d570 tx=0x7f838001c460 comp rx=0 tx=0).stop 2024-04-25T13:41:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f838c022640 1 -- 172.21.15.77:0/3515911652 shutdown_connections 2024-04-25T13:41:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f838c022640 1 --2- 172.21.15.77:0/3515911652 >> v2:172.21.15.96:3300/0 conn(0x7f83840c1ee0 0x7f83840c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f838c022640 1 --2- 172.21.15.77:0/3515911652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840a6870 0x7f83840a6c80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f838c022640 1 --2- 172.21.15.77:0/3515911652 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 0x7f838406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f838c022640 1 -- 172.21.15.77:0/3515911652 >> 172.21.15.77:0/3515911652 conn(0x7f83840c7890 msgr2=0x7f83840c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f838c022640 1 -- 172.21.15.77:0/3515911652 shutdown_connections 2024-04-25T13:41:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.375+0000 7f838c022640 1 -- 172.21.15.77:0/3515911652 wait complete. 2024-04-25T13:41:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 Processor -- start 2024-04-25T13:41:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 -- start start 2024-04-25T13:41:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83840a6870 0x7f838414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840c1ee0 0x7f83840ba250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 0x7f83840ba790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f83840c6120 con 0x7f83840c1ee0 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f83840c5fa0 con 0x7f83840a6870 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f83840c62a0 con 0x7f83840c69b0 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83895bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840c1ee0 0x7f83840ba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83895bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840c1ee0 0x7f83840ba250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42564/0 (socket says 172.21.15.77:42564) 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83895bd640 1 -- 172.21.15.77:0/2282084324 learned_addr learned my addr 172.21.15.77:0/2282084324 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f8389dbe640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83840a6870 0x7f838414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838a5bf640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 0x7f83840ba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83895bd640 1 -- 172.21.15.77:0/2282084324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 msgr2=0x7f83840ba790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83895bd640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 0x7f83840ba790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83895bd640 1 -- 172.21.15.77:0/2282084324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83840a6870 msgr2=0x7f838414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83895bd640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83840a6870 0x7f838414c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83895bd640 1 -- 172.21.15.77:0/2282084324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83840beea0 con 0x7f83840c1ee0 2024-04-25T13:41:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83895bd640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840c1ee0 0x7f83840ba250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8380000c10 tx=0x7f838001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83767fc640 1 -- 172.21.15.77:0/2282084324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83800b1040 con 0x7f83840c1ee0 2024-04-25T13:41:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83767fc640 1 -- 172.21.15.77:0/2282084324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83800bc070 con 0x7f83840c1ee0 2024-04-25T13:41:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f83767fc640 1 -- 172.21.15.77:0/2282084324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83800b7690 con 0x7f83840c1ee0 2024-04-25T13:41:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83840bf3b0 con 0x7f83840c1ee0 2024-04-25T13:41:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.379+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83840bacd0 con 0x7f83840c1ee0 2024-04-25T13:41:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.383+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838406a1a0 con 0x7f83840c1ee0 2024-04-25T13:41:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.383+0000 7f83767fc640 1 -- 172.21.15.77:0/2282084324 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f83800b7830 con 0x7f83840c1ee0 2024-04-25T13:41:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.383+0000 7f83767fc640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f836806f430 0x7f8368071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.383+0000 7f83767fc640 1 -- 172.21.15.77:0/2282084324 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f83801295e0 con 0x7f83840c1ee0 2024-04-25T13:41:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.383+0000 7f8389dbe640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f836806f430 0x7f8368071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.383+0000 7f8389dbe640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f836806f430 0x7f8368071940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f837800b930 tx=0x7f8378008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.387+0000 7f83767fc640 1 -- 172.21.15.77:0/2282084324 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8380016110 con 0x7f83840c1ee0 2024-04-25T13:41:14.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.551+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f838406ef40 con 0x7f83840c1ee0 2024-04-25T13:41:14.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f83767fc640 1 -- 172.21.15.77:0/2282084324 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f83800f6560 con 0x7f83840c1ee0 2024-04-25T13:41:14.555 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T13:41:14.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f836806f430 msgr2=0x7f8368071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f836806f430 0x7f8368071940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f837800b930 tx=0x7f8378008040 comp rx=0 tx=0).stop 2024-04-25T13:41:14.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840c1ee0 msgr2=0x7f83840ba250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840c1ee0 0x7f83840ba250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8380000c10 tx=0x7f838001aca0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 shutdown_connections 2024-04-25T13:41:14.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f836806f430 0x7f8368071940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83840c69b0 0x7f83840ba790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840c1ee0 0x7f83840ba250 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 --2- 172.21.15.77:0/2282084324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83840a6870 0x7f838414c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 >> 172.21.15.77:0/2282084324 conn(0x7f83840c7890 msgr2=0x7f83840aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:14.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 shutdown_connections 2024-04-25T13:41:14.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.555+0000 7f838c022640 1 -- 172.21.15.77:0/2282084324 wait complete. 2024-04-25T13:41:14.577 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:41:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe20d11e640 1 Processor -- start 2024-04-25T13:41:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe20d11e640 1 -- start start 2024-04-25T13:41:14.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe20d11e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2080bf910 0x7fe20814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe20d11e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe208152260 0x7fe208152670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe20d11e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2080a4b10 con 0x7fe2080c0b70 2024-04-25T13:41:14.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe20d11e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe2080a50d0 con 0x7fe2080bf910 2024-04-25T13:41:14.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe20d11e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe2080a4df0 con 0x7fe208152260 2024-04-25T13:41:14.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe206d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2080bf910 0x7fe20814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe206d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2080bf910 0x7fe20814e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42570/0 (socket says 172.21.15.77:42570) 2024-04-25T13:41:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe20659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe2080c0b70 0x7fe20814f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59120/0 (socket says 172.21.15.77:59120) 2024-04-25T13:41:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe206d9d640 1 -- 172.21.15.77:0/1388740119 learned_addr learned my addr 172.21.15.77:0/1388740119 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe20759e640 1 --2- 172.21.15.77:0/1388740119 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe208152260 0x7fe208152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe206d9d640 1 -- 172.21.15.77:0/1388740119 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe208152260 msgr2=0x7fe208152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe206d9d640 1 --2- 172.21.15.77:0/1388740119 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe208152260 0x7fe208152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe206d9d640 1 -- 172.21.15.77:0/1388740119 >> v1:172.21.15.77:6789/0 conn(0x7fe2080c0b70 legacy=0x7fe20814f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe206d9d640 1 -- 172.21.15.77:0/1388740119 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2080a2fb0 con 0x7fe2080bf910 2024-04-25T13:41:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.723+0000 7fe205d9b640 1 -- 172.21.15.77:0/1388740119 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038012016 0 0) 0x7fe2080a4b10 con 0x7fe2080c0b70 2024-04-25T13:41:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe206d9d640 1 --2- 172.21.15.77:0/1388740119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 0x7fe20814e8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009eb0 tx=0x7fe1f801ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b99cedfaf77768 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe205d9b640 1 -- 172.21.15.77:0/1388740119 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80a7a90 con 0x7fe2080bf910 2024-04-25T13:41:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe205d9b640 1 -- 172.21.15.77:0/1388740119 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f80a7c30 con 0x7fe2080bf910 2024-04-25T13:41:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe205d9b640 1 -- 172.21.15.77:0/1388740119 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80af3f0 con 0x7fe2080bf910 2024-04-25T13:41:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 -- 172.21.15.77:0/1388740119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 msgr2=0x7fe20814e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 --2- 172.21.15.77:0/1388740119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 0x7fe20814e8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009eb0 tx=0x7fe1f801ec20 comp rx=0 tx=0).stop 2024-04-25T13:41:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 -- 172.21.15.77:0/1388740119 shutdown_connections 2024-04-25T13:41:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 --2- 172.21.15.77:0/1388740119 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe208152260 0x7fe208152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 --2- 172.21.15.77:0/1388740119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 0x7fe20814e8a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 -- 172.21.15.77:0/1388740119 >> 172.21.15.77:0/1388740119 conn(0x7fe2080c3cd0 msgr2=0x7fe2080c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 -- 172.21.15.77:0/1388740119 shutdown_connections 2024-04-25T13:41:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 -- 172.21.15.77:0/1388740119 wait complete. 2024-04-25T13:41:14.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 Processor -- start 2024-04-25T13:41:14.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.727+0000 7fe20d11e640 1 -- start start 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20d11e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 0x7fe20813ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20d11e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2080c0b70 0x7fe20813d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20d11e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe208152260 0x7fe208148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20d11e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe20815b1c0 con 0x7fe2080bf910 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20d11e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe208152dc0 con 0x7fe208152260 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20d11e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe20815b340 con 0x7fe2080c0b70 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe206d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 0x7fe20813ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe206d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 0x7fe20813ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42584/0 (socket says 172.21.15.77:42584) 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe206d9d640 1 -- 172.21.15.77:0/3186198465 learned_addr learned my addr 172.21.15.77:0/3186198465 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20659c640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2080c0b70 0x7fe20813d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20759e640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe208152260 0x7fe208148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe206d9d640 1 -- 172.21.15.77:0/3186198465 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2080c0b70 msgr2=0x7fe20813d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe206d9d640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2080c0b70 0x7fe20813d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe206d9d640 1 -- 172.21.15.77:0/3186198465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe208152260 msgr2=0x7fe208148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe206d9d640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe208152260 0x7fe208148f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe206d9d640 1 -- 172.21.15.77:0/3186198465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2081ec810 con 0x7fe2080bf910 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20659c640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2080c0b70 0x7fe20813d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe206d9d640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 0x7fe20813ce60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1f801c850 tx=0x7fe1f801b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe1ef7fe640 1 -- 172.21.15.77:0/3186198465 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80be070 con 0x7fe2080bf910 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe1ef7fe640 1 -- 172.21.15.77:0/3186198465 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f80090d0 con 0x7fe2080bf910 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe1ef7fe640 1 -- 172.21.15.77:0/3186198465 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80a7a90 con 0x7fe2080bf910 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2081483b0 con 0x7fe2080bf910 2024-04-25T13:41:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe208145200 con 0x7fe2080bf910 2024-04-25T13:41:14.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe208145400 con 0x7fe2080bf910 2024-04-25T13:41:14.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.731+0000 7fe1ef7fe640 1 -- 172.21.15.77:0/3186198465 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe1f80af3f0 con 0x7fe2080bf910 2024-04-25T13:41:14.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.735+0000 7fe1ef7fe640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe1f406f400 0x7fe1f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:14.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.735+0000 7fe1ef7fe640 1 -- 172.21.15.77:0/3186198465 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe1f81294a0 con 0x7fe2080bf910 2024-04-25T13:41:14.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.735+0000 7fe20659c640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe1f406f400 0x7fe1f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:14.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.735+0000 7fe20659c640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe1f406f400 0x7fe1f4071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007fd0 tx=0x7fe1fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:14.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.739+0000 7fe1ef7fe640 1 -- 172.21.15.77:0/3186198465 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe1f8018810 con 0x7fe2080bf910 2024-04-25T13:41:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe20806a1a0 con 0x7fe2080bf910 2024-04-25T13:41:14.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe1ef7fe640 1 -- 172.21.15.77:0/3186198465 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fe1f80f6390 con 0x7fe2080bf910 2024-04-25T13:41:14.888 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe1f406f400 msgr2=0x7fe1f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe1f406f400 0x7fe1f4071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007fd0 tx=0x7fe1fc009040 comp rx=0 tx=0).stop 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 msgr2=0x7fe20813ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 0x7fe20813ce60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1f801c850 tx=0x7fe1f801b9c0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 shutdown_connections 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe1f406f400 0x7fe1f4071910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe208152260 0x7fe208148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe2080c0b70 0x7fe20813d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 --2- 172.21.15.77:0/3186198465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2080bf910 0x7fe20813ce60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 >> 172.21.15.77:0/3186198465 conn(0x7fe2080c3cd0 msgr2=0x7fe2080a6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:14.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.887+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 shutdown_connections 2024-04-25T13:41:14.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:14.891+0000 7fe20d11e640 1 -- 172.21.15.77:0/3186198465 wait complete. 2024-04-25T13:41:14.909 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:41:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ef3e640 1 Processor -- start 2024-04-25T13:41:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ef3e640 1 -- start start 2024-04-25T13:41:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ef3e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0b880a5580 0x7f0b8806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ef3e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b8806ff10 0x7f0b880a7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ef3e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0b880a7ed0 0x7f0b880a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ef3e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0b880a3760 con 0x7f0b880a7ed0 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ef3e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0b880a8820 con 0x7f0b880a5580 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ef3e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f0b88153090 con 0x7f0b8806ff10 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8d4db640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0b880a7ed0 0x7f0b880a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8d4db640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0b880a7ed0 0x7f0b880a82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42586/0 (socket says 172.21.15.77:42586) 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8d4db640 1 -- 172.21.15.77:0/2828585169 learned_addr learned my addr 172.21.15.77:0/2828585169 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ccda640 1 --2- 172.21.15.77:0/2828585169 >> v2:172.21.15.96:3300/0 conn(0x7f0b880a5580 0x7f0b8806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b87fff640 1 --2- 172.21.15.77:0/2828585169 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b8806ff10 0x7f0b880a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8d4db640 1 -- 172.21.15.77:0/2828585169 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b8806ff10 msgr2=0x7f0b880a7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8d4db640 1 --2- 172.21.15.77:0/2828585169 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b8806ff10 0x7f0b880a7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8d4db640 1 -- 172.21.15.77:0/2828585169 >> v2:172.21.15.96:3300/0 conn(0x7f0b880a5580 msgr2=0x7f0b8806f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8d4db640 1 --2- 172.21.15.77:0/2828585169 >> v2:172.21.15.96:3300/0 conn(0x7f0b880a5580 0x7f0b8806f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8d4db640 1 -- 172.21.15.77:0/2828585169 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b881535c0 con 0x7f0b880a7ed0 2024-04-25T13:41:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.043+0000 7f0b8ccda640 1 --2- 172.21.15.77:0/2828585169 >> v2:172.21.15.96:3300/0 conn(0x7f0b880a5580 0x7f0b8806f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8d4db640 1 --2- 172.21.15.77:0/2828585169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a7ed0 0x7f0b880a82e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b88070b10 tx=0x7f0b8001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e195c4eed9d276 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b877fe640 1 -- 172.21.15.77:0/2828585169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b800a5760 con 0x7f0b880a7ed0 2024-04-25T13:41:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b877fe640 1 -- 172.21.15.77:0/2828585169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b800a5900 con 0x7f0b880a7ed0 2024-04-25T13:41:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b877fe640 1 -- 172.21.15.77:0/2828585169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b800a5cd0 con 0x7f0b880a7ed0 2024-04-25T13:41:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2828585169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a7ed0 msgr2=0x7f0b880a82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2828585169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a7ed0 0x7f0b880a82e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b88070b10 tx=0x7f0b8001c9f0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2828585169 shutdown_connections 2024-04-25T13:41:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2828585169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a7ed0 0x7f0b880a82e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2828585169 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b8806ff10 0x7f0b880a7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2828585169 >> v2:172.21.15.96:3300/0 conn(0x7f0b880a5580 0x7f0b8806f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2828585169 >> 172.21.15.77:0/2828585169 conn(0x7f0b880c3cd0 msgr2=0x7f0b880c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2828585169 shutdown_connections 2024-04-25T13:41:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.047+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2828585169 wait complete. 2024-04-25T13:41:15.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 Processor -- start 2024-04-25T13:41:15.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 -- start start 2024-04-25T13:41:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b8806ff10 0x7f0b88144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a5580 0x7f0b8814b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b880a7ed0 0x7f0b8814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8814f2b0 con 0x7f0b880a5580 2024-04-25T13:41:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8814f130 con 0x7f0b8806ff10 2024-04-25T13:41:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8814f430 con 0x7f0b880a7ed0 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b87fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a5580 0x7f0b8814b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b87fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a5580 0x7f0b8814b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42594/0 (socket says 172.21.15.77:42594) 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b87fff640 1 -- 172.21.15.77:0/2004665120 learned_addr learned my addr 172.21.15.77:0/2004665120 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8d4db640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b880a7ed0 0x7f0b8814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ccda640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b8806ff10 0x7f0b88144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b87fff640 1 -- 172.21.15.77:0/2004665120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b880a7ed0 msgr2=0x7f0b8814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b87fff640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b880a7ed0 0x7f0b8814b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b87fff640 1 -- 172.21.15.77:0/2004665120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b8806ff10 msgr2=0x7f0b88144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b87fff640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b8806ff10 0x7f0b88144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b87fff640 1 -- 172.21.15.77:0/2004665120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b88143bd0 con 0x7f0b880a5580 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ccda640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b8806ff10 0x7f0b88144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b87fff640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a5580 0x7f0b8814b210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000c5c0 tx=0x7f0b7000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b857fa640 1 -- 172.21.15.77:0/2004665120 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70015070 con 0x7f0b880a5580 2024-04-25T13:41:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b857fa640 1 -- 172.21.15.77:0/2004665120 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b70011800 con 0x7f0b880a5580 2024-04-25T13:41:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b881e9130 con 0x7f0b880a5580 2024-04-25T13:41:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b857fa640 1 -- 172.21.15.77:0/2004665120 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70011bd0 con 0x7f0b880a5580 2024-04-25T13:41:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b88143dd0 con 0x7f0b880a5580 2024-04-25T13:41:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.051+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b8806a1a0 con 0x7f0b880a5580 2024-04-25T13:41:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.055+0000 7f0b857fa640 1 -- 172.21.15.77:0/2004665120 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0b70018070 con 0x7f0b880a5580 2024-04-25T13:41:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.055+0000 7f0b857fa640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b6806f430 0x7f0b68071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.055+0000 7f0b8ccda640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b6806f430 0x7f0b68071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.055+0000 7f0b857fa640 1 -- 172.21.15.77:0/2004665120 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b7008f0b0 con 0x7f0b880a5580 2024-04-25T13:41:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.055+0000 7f0b8ccda640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b6806f430 0x7f0b68071940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b78008890 tx=0x7f0b78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:15.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.059+0000 7f0b857fa640 1 -- 172.21.15.77:0/2004665120 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b88143bd0 con 0x7f0b880a5580 2024-04-25T13:41:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0b880c2180 con 0x7f0b880a5580 2024-04-25T13:41:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b857fa640 1 -- 172.21.15.77:0/2004665120 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f0b7005bfa0 con 0x7f0b880a5580 2024-04-25T13:41:15.220 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T13:41:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b6806f430 msgr2=0x7f0b68071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b6806f430 0x7f0b68071940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b78008890 tx=0x7f0b78008040 comp rx=0 tx=0).stop 2024-04-25T13:41:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a5580 msgr2=0x7f0b8814b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a5580 0x7f0b8814b210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000c5c0 tx=0x7f0b7000ca80 comp rx=0 tx=0).stop 2024-04-25T13:41:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 shutdown_connections 2024-04-25T13:41:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b6806f430 0x7f0b68071940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b880a7ed0 0x7f0b8814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b880a5580 0x7f0b8814b210 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 --2- 172.21.15.77:0/2004665120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b8806ff10 0x7f0b88144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 >> 172.21.15.77:0/2004665120 conn(0x7f0b880c3cd0 msgr2=0x7f0b880756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 shutdown_connections 2024-04-25T13:41:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.219+0000 7f0b8ef3e640 1 -- 172.21.15.77:0/2004665120 wait complete. 2024-04-25T13:41:15.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:15.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0da97b640 1 Processor -- start 2024-04-25T13:41:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0da97b640 1 -- start start 2024-04-25T13:41:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0da97b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0d4074820 0x7fd0d406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0da97b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd0d4073bc0 0x7fd0d4073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0da97b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d40a9330 con 0x7fd0d40a8f20 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0da97b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd0d406cd80 con 0x7fd0d4074820 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0da97b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd0d4074c30 con 0x7fd0d4073bc0 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0d37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0d4074820 0x7fd0d406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0d37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0d4074820 0x7fd0d406c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42608/0 (socket says 172.21.15.77:42608) 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0d37fe640 1 -- 172.21.15.77:0/1200289828 learned_addr learned my addr 172.21.15.77:0/1200289828 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0d8f18640 1 --2- 172.21.15.77:0/1200289828 >> v2:172.21.15.96:3300/0 conn(0x7fd0d4073bc0 0x7fd0d4073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0d37fe640 1 -- 172.21.15.77:0/1200289828 >> v2:172.21.15.96:3300/0 conn(0x7fd0d4073bc0 msgr2=0x7fd0d4073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0d37fe640 1 --2- 172.21.15.77:0/1200289828 >> v2:172.21.15.96:3300/0 conn(0x7fd0d4073bc0 0x7fd0d4073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0d37fe640 1 -- 172.21.15.77:0/1200289828 >> v1:172.21.15.96:6789/0 conn(0x7fd0d40a8f20 legacy=0x7fd0d4151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.375+0000 7fd0d37fe640 1 -- 172.21.15.77:0/1200289828 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d4073800 con 0x7fd0d4074820 2024-04-25T13:41:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0d37fe640 1 --2- 172.21.15.77:0/1200289828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4074820 0x7fd0d406c840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40a4090 tx=0x7fd0c801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d4686e4ad71483 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0d2ffd640 1 -- 172.21.15.77:0/1200289828 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c80b2070 con 0x7fd0d4074820 2024-04-25T13:41:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0d2ffd640 1 -- 172.21.15.77:0/1200289828 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c80ad680 con 0x7fd0d4074820 2024-04-25T13:41:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0d2ffd640 1 -- 172.21.15.77:0/1200289828 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c80ada50 con 0x7fd0d4074820 2024-04-25T13:41:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 -- 172.21.15.77:0/1200289828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4074820 msgr2=0x7fd0d406c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 --2- 172.21.15.77:0/1200289828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4074820 0x7fd0d406c840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40a4090 tx=0x7fd0c801c490 comp rx=0 tx=0).stop 2024-04-25T13:41:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 -- 172.21.15.77:0/1200289828 shutdown_connections 2024-04-25T13:41:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 --2- 172.21.15.77:0/1200289828 >> v2:172.21.15.96:3300/0 conn(0x7fd0d4073bc0 0x7fd0d4073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 --2- 172.21.15.77:0/1200289828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4074820 0x7fd0d406c840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 -- 172.21.15.77:0/1200289828 >> 172.21.15.77:0/1200289828 conn(0x7fd0d40c48b0 msgr2=0x7fd0d40c4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 -- 172.21.15.77:0/1200289828 shutdown_connections 2024-04-25T13:41:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 -- 172.21.15.77:0/1200289828 wait complete. 2024-04-25T13:41:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 Processor -- start 2024-04-25T13:41:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.379+0000 7fd0da97b640 1 -- start start 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0da97b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4073bc0 0x7fd0d40bf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0da97b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4074820 0x7fd0d41f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0da97b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd0d40a8f20 0x7fd0d41f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0da97b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4152390 con 0x7fd0d4073bc0 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0da97b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4152210 con 0x7fd0d4074820 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0da97b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d415f5e0 con 0x7fd0d40a8f20 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4073bc0 0x7fd0d40bf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4073bc0 0x7fd0d40bf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42612/0 (socket says 172.21.15.77:42612) 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d3fff640 1 -- 172.21.15.77:0/182012580 learned_addr learned my addr 172.21.15.77:0/182012580 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d8f18640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd0d40a8f20 0x7fd0d41f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d3fff640 1 -- 172.21.15.77:0/182012580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd0d40a8f20 msgr2=0x7fd0d41f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d3fff640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd0d40a8f20 0x7fd0d41f13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d37fe640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4074820 0x7fd0d41f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d3fff640 1 -- 172.21.15.77:0/182012580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4074820 msgr2=0x7fd0d41f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d3fff640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4074820 0x7fd0d41f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d3fff640 1 -- 172.21.15.77:0/182012580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d41f0900 con 0x7fd0d4073bc0 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d3fff640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4073bc0 0x7fd0d40bf890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c310 tx=0x7fd0c400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d0ff9640 1 -- 172.21.15.77:0/182012580 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40052d0 con 0x7fd0d4073bc0 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d0ff9640 1 -- 172.21.15.77:0/182012580 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c4005470 con 0x7fd0d4073bc0 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d40c0980 con 0x7fd0d4073bc0 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d0ff9640 1 -- 172.21.15.77:0/182012580 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4007260 con 0x7fd0d4073bc0 2024-04-25T13:41:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d41f1960 con 0x7fd0d4073bc0 2024-04-25T13:41:15.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d406a280 con 0x7fd0d4073bc0 2024-04-25T13:41:15.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d0ff9640 1 -- 172.21.15.77:0/182012580 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd0c4007400 con 0x7fd0d4073bc0 2024-04-25T13:41:15.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.383+0000 7fd0d0ff9640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd0c006f400 0x7fd0c0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.387+0000 7fd0d0ff9640 1 -- 172.21.15.77:0/182012580 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd0c408e780 con 0x7fd0d4073bc0 2024-04-25T13:41:15.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.387+0000 7fd0d37fe640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd0c006f400 0x7fd0c0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.387+0000 7fd0d37fe640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd0c006f400 0x7fd0c0071910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80af000 tx=0x7fd0c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:15.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.391+0000 7fd0d0ff9640 1 -- 172.21.15.77:0/182012580 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd0d40a9330 con 0x7fd0d4073bc0 2024-04-25T13:41:15.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.571+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0d40bc520 con 0x7fd0d4073bc0 2024-04-25T13:41:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.575+0000 7fd0d0ff9640 1 -- 172.21.15.77:0/182012580 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7fd0c405b670 con 0x7fd0d4073bc0 2024-04-25T13:41:15.576 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:15.576 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2393103049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2393103049},{"type":"v1","addr":"172.21.15.77:6835","nonce":2393103049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:41:03.799479+0000","modified":"2024-04-25T13:41:06.824136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6833/1035589958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":1035589958},{"type":"v1","addr":"172.21.15.96:6833","nonce":1035589958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-25T13:41:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-04-25T13:41:15.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd0c006f400 msgr2=0x7fd0c0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd0c006f400 0x7fd0c0071910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80af000 tx=0x7fd0c8008040 comp rx=0 tx=0).stop 2024-04-25T13:41:15.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4073bc0 msgr2=0x7fd0d40bf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4073bc0 0x7fd0d40bf890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c310 tx=0x7fd0c400c7d0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 shutdown_connections 2024-04-25T13:41:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd0c006f400 0x7fd0c0071910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd0d40a8f20 0x7fd0d41f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4074820 0x7fd0d41f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 --2- 172.21.15.77:0/182012580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0d4073bc0 0x7fd0d40bf890 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 >> 172.21.15.77:0/182012580 conn(0x7fd0d40c48b0 msgr2=0x7fd0d40c4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 shutdown_connections 2024-04-25T13:41:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.579+0000 7fd0da97b640 1 -- 172.21.15.77:0/182012580 wait complete. 2024-04-25T13:41:15.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.727+0000 7ff3d387a640 1 Processor -- start 2024-04-25T13:41:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.727+0000 7ff3d387a640 1 -- start start 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d387a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff3cc0c6100 0x7ff3cc152480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d387a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3cc06dae0 0x7ff3cc152d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d387a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3cc0c3200 con 0x7ff3cc153250 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d387a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff3cc0c37c0 con 0x7ff3cc0c6100 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d387a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff3cc0c34e0 con 0x7ff3cc06dae0 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d1616640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff3cc0c6100 0x7ff3cc152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d1616640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff3cc0c6100 0x7ff3cc152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42628/0 (socket says 172.21.15.77:42628) 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d1616640 1 -- 172.21.15.77:0/866515950 learned_addr learned my addr 172.21.15.77:0/866515950 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d0e15640 1 --2- 172.21.15.77:0/866515950 >> v2:172.21.15.96:3300/0 conn(0x7ff3cc06dae0 0x7ff3cc152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d1616640 1 -- 172.21.15.77:0/866515950 >> v2:172.21.15.96:3300/0 conn(0x7ff3cc06dae0 msgr2=0x7ff3cc152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d1616640 1 --2- 172.21.15.77:0/866515950 >> v2:172.21.15.96:3300/0 conn(0x7ff3cc06dae0 0x7ff3cc152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d1616640 1 -- 172.21.15.77:0/866515950 >> v1:172.21.15.96:6789/0 conn(0x7ff3cc153250 legacy=0x7ff3cc155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:15.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.731+0000 7ff3d1616640 1 -- 172.21.15.77:0/866515950 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc1529c0 con 0x7ff3cc0c6100 2024-04-25T13:41:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d1616640 1 --2- 172.21.15.77:0/866515950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc0c6100 0x7ff3cc152480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc08d570 tx=0x7ff3c801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce85853485c5c301 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3c3fff640 1 -- 172.21.15.77:0/866515950 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80aa660 con 0x7ff3cc0c6100 2024-04-25T13:41:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3c3fff640 1 -- 172.21.15.77:0/866515950 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c80af070 con 0x7ff3cc0c6100 2024-04-25T13:41:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3c3fff640 1 -- 172.21.15.77:0/866515950 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80aaa20 con 0x7ff3cc0c6100 2024-04-25T13:41:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 -- 172.21.15.77:0/866515950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc0c6100 msgr2=0x7ff3cc152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 --2- 172.21.15.77:0/866515950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc0c6100 0x7ff3cc152480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc08d570 tx=0x7ff3c801c4e0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 -- 172.21.15.77:0/866515950 shutdown_connections 2024-04-25T13:41:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 --2- 172.21.15.77:0/866515950 >> v2:172.21.15.96:3300/0 conn(0x7ff3cc06dae0 0x7ff3cc152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 --2- 172.21.15.77:0/866515950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc0c6100 0x7ff3cc152480 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 -- 172.21.15.77:0/866515950 >> 172.21.15.77:0/866515950 conn(0x7ff3cc0c79c0 msgr2=0x7ff3cc0c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 -- 172.21.15.77:0/866515950 shutdown_connections 2024-04-25T13:41:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 -- 172.21.15.77:0/866515950 wait complete. 2024-04-25T13:41:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 Processor -- start 2024-04-25T13:41:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.735+0000 7ff3d387a640 1 -- start start 2024-04-25T13:41:15.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d387a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc06dae0 0x7ff3cc14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d387a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3cc0c6100 0x7ff3cc0c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d387a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3cc153250 0x7ff3cc0c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d387a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc0ad640 con 0x7ff3cc06dae0 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d387a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc156b00 con 0x7ff3cc0c6100 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d387a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff3cc0ad7c0 con 0x7ff3cc153250 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d1616640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc06dae0 0x7ff3cc14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d1616640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc06dae0 0x7ff3cc14edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42636/0 (socket says 172.21.15.77:42636) 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d1616640 1 -- 172.21.15.77:0/1688861475 learned_addr learned my addr 172.21.15.77:0/1688861475 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d0e15640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3cc0c6100 0x7ff3cc0c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d1616640 1 -- 172.21.15.77:0/1688861475 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3cc153250 msgr2=0x7ff3cc0c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d1616640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3cc153250 0x7ff3cc0c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d1616640 1 -- 172.21.15.77:0/1688861475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3cc0c6100 msgr2=0x7ff3cc0c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d1616640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3cc0c6100 0x7ff3cc0c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d1616640 1 -- 172.21.15.77:0/1688861475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc151af0 con 0x7ff3cc06dae0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d1616640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc06dae0 0x7ff3cc14edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80ac040 tx=0x7ff3c801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3c1ffb640 1 -- 172.21.15.77:0/1688861475 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80bd5f0 con 0x7ff3cc06dae0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3c1ffb640 1 -- 172.21.15.77:0/1688861475 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c80bd7b0 con 0x7ff3cc06dae0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc151140 con 0x7ff3cc06dae0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3c1ffb640 1 -- 172.21.15.77:0/1688861475 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80bdba0 con 0x7ff3cc06dae0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc14f2f0 con 0x7ff3cc06dae0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3cc06a280 con 0x7ff3cc06dae0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3c1ffb640 1 -- 172.21.15.77:0/1688861475 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff3c80b33f0 con 0x7ff3cc06dae0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3c1ffb640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff3b006f400 0x7ff3b0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3c1ffb640 1 -- 172.21.15.77:0/1688861475 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff3c812a260 con 0x7ff3cc06dae0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d0e15640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff3b006f400 0x7ff3b0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.739+0000 7ff3d0e15640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff3b006f400 0x7ff3b0071910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0c8270 tx=0x7ff3bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.743+0000 7ff3c1ffb640 1 -- 172.21.15.77:0/1688861475 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3c80c3060 con 0x7ff3cc06dae0 2024-04-25T13:41:15.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.895+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3cc0c0920 con 0x7ff3cc06dae0 2024-04-25T13:41:15.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3c1ffb640 1 -- 172.21.15.77:0/1688861475 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16557 (secure 0 0 0) 0x7ff3c80160d0 con 0x7ff3cc06dae0 2024-04-25T13:41:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:15.900 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:05.383876+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:15.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff3b006f400 msgr2=0x7ff3b0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff3b006f400 0x7ff3b0071910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0c8270 tx=0x7ff3bc008040 comp rx=0 tx=0).stop 2024-04-25T13:41:15.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc06dae0 msgr2=0x7ff3cc14edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc06dae0 0x7ff3cc14edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80ac040 tx=0x7ff3c801ad20 comp rx=0 tx=0).stop 2024-04-25T13:41:15.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 shutdown_connections 2024-04-25T13:41:15.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff3b006f400 0x7ff3b0071910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3cc153250 0x7ff3cc0c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3cc0c6100 0x7ff3cc0c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 --2- 172.21.15.77:0/1688861475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3cc06dae0 0x7ff3cc14edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 >> 172.21.15.77:0/1688861475 conn(0x7ff3cc0c79c0 msgr2=0x7ff3cc14d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:15.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 shutdown_connections 2024-04-25T13:41:15.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:15.899+0000 7ff3d387a640 1 -- 172.21.15.77:0/1688861475 wait complete. 2024-04-25T13:41:15.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:16.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.051+0000 7fcd4f4d4640 1 Processor -- start 2024-04-25T13:41:16.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.051+0000 7fcd4f4d4640 1 -- start start 2024-04-25T13:41:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4f4d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd48146cb0 0x7fcd48071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4f4d4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48073bc0 0x7fcd48073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4f4d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd481470c0 con 0x7fcd480b85f0 2024-04-25T13:41:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4f4d4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcd48074510 con 0x7fcd48146cb0 2024-04-25T13:41:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4f4d4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fcd48150ff0 con 0x7fcd48073bc0 2024-04-25T13:41:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4d270640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcd480b85f0 0x7fcd4806f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59124/0 (socket says 172.21.15.77:59124) 2024-04-25T13:41:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4d270640 1 -- 172.21.15.77:0/304963962 learned_addr learned my addr 172.21.15.77:0/304963962 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4ca6f640 1 --2- 172.21.15.77:0/304963962 >> v2:172.21.15.77:3300/0 conn(0x7fcd48146cb0 0x7fcd48071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4da71640 1 --2- 172.21.15.77:0/304963962 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48073bc0 0x7fcd48073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4ca6f640 1 -- 172.21.15.77:0/304963962 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48073bc0 msgr2=0x7fcd48073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4ca6f640 1 --2- 172.21.15.77:0/304963962 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48073bc0 0x7fcd48073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd3ffff640 1 -- 172.21.15.77:0/304963962 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919511383 0 0) 0x7fcd481470c0 con 0x7fcd480b85f0 2024-04-25T13:41:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4ca6f640 1 -- 172.21.15.77:0/304963962 >> v1:172.21.15.77:6789/0 conn(0x7fcd480b85f0 legacy=0x7fcd4806f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4ca6f640 1 -- 172.21.15.77:0/304963962 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd480733c0 con 0x7fcd48146cb0 2024-04-25T13:41:16.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.055+0000 7fcd4ca6f640 1 --2- 172.21.15.77:0/304963962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48146cb0 0x7fcd48071900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcd440097c0 tx=0x7fcd4401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666b3f227c5098c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd3ffff640 1 -- 172.21.15.77:0/304963962 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440b1070 con 0x7fcd48146cb0 2024-04-25T13:41:16.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd3ffff640 1 -- 172.21.15.77:0/304963962 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd440ac600 con 0x7fcd48146cb0 2024-04-25T13:41:16.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd3ffff640 1 -- 172.21.15.77:0/304963962 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd440ac9d0 con 0x7fcd48146cb0 2024-04-25T13:41:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/304963962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48146cb0 msgr2=0x7fcd48071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 --2- 172.21.15.77:0/304963962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48146cb0 0x7fcd48071900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcd440097c0 tx=0x7fcd4401c3e0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/304963962 shutdown_connections 2024-04-25T13:41:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 --2- 172.21.15.77:0/304963962 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48073bc0 0x7fcd48073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 --2- 172.21.15.77:0/304963962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48146cb0 0x7fcd48071900 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/304963962 >> 172.21.15.77:0/304963962 conn(0x7fcd480c02a0 msgr2=0x7fcd480c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/304963962 shutdown_connections 2024-04-25T13:41:16.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/304963962 wait complete. 2024-04-25T13:41:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 Processor -- start 2024-04-25T13:41:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.059+0000 7fcd4f4d4640 1 -- start start 2024-04-25T13:41:16.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4f4d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48073bc0 0x7fcd4813ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4f4d4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd480b85f0 0x7fcd48138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4f4d4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48146cb0 0x7fcd48138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4f4d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4815d540 con 0x7fcd48073bc0 2024-04-25T13:41:16.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4f4d4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4815d3c0 con 0x7fcd480b85f0 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4f4d4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4815d6c0 con 0x7fcd48146cb0 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4d270640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48073bc0 0x7fcd4813ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4d270640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48073bc0 0x7fcd4813ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42660/0 (socket says 172.21.15.77:42660) 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4d270640 1 -- 172.21.15.77:0/1069592690 learned_addr learned my addr 172.21.15.77:0/1069592690 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4da71640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48146cb0 0x7fcd48138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4ca6f640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd480b85f0 0x7fcd48138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4d270640 1 -- 172.21.15.77:0/1069592690 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48146cb0 msgr2=0x7fcd48138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4d270640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48146cb0 0x7fcd48138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4d270640 1 -- 172.21.15.77:0/1069592690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd480b85f0 msgr2=0x7fcd48138a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4d270640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd480b85f0 0x7fcd48138a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4d270640 1 -- 172.21.15.77:0/1069592690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd48139b20 con 0x7fcd48073bc0 2024-04-25T13:41:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4d270640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48073bc0 0x7fcd4813ee90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800c3c0 tx=0x7fcd3800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd3dffb640 1 -- 172.21.15.77:0/1069592690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38017070 con 0x7fcd48073bc0 2024-04-25T13:41:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd3dffb640 1 -- 172.21.15.77:0/1069592690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd380074e0 con 0x7fcd48073bc0 2024-04-25T13:41:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd481ed6d0 con 0x7fcd48073bc0 2024-04-25T13:41:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd3dffb640 1 -- 172.21.15.77:0/1069592690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd380059f0 con 0x7fcd48073bc0 2024-04-25T13:41:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd481ebd80 con 0x7fcd48073bc0 2024-04-25T13:41:16.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4806a280 con 0x7fcd48073bc0 2024-04-25T13:41:16.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd3dffb640 1 -- 172.21.15.77:0/1069592690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcd3801a070 con 0x7fcd48073bc0 2024-04-25T13:41:16.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd3dffb640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd2c06f430 0x7fcd2c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd4ca6f640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd2c06f430 0x7fcd2c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.063+0000 7fcd3dffb640 1 -- 172.21.15.77:0/1069592690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcd3808e5e0 con 0x7fcd48073bc0 2024-04-25T13:41:16.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.067+0000 7fcd4ca6f640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd2c06f430 0x7fcd2c071940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcd440ae000 tx=0x7fcd440a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.067+0000 7fcd3dffb640 1 -- 172.21.15.77:0/1069592690 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd3805b4d0 con 0x7fcd48073bc0 2024-04-25T13:41:16.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd4815a980 con 0x7fcd48073bc0 2024-04-25T13:41:16.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd3dffb640 1 -- 172.21.15.77:0/1069592690 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7fcd3805add0 con 0x7fcd48073bc0 2024-04-25T13:41:16.252 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:41:16.252 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2393103049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2393103049},{"type":"v1","addr":"172.21.15.77:6835","nonce":2393103049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:41:03.799479+0000","modified":"2024-04-25T13:41:06.824136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6833/1035589958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":1035589958},{"type":"v1","addr":"172.21.15.96:6833","nonce":1035589958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-25T13:41:16.253 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-04-25T13:41:16.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd2c06f430 msgr2=0x7fcd2c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd2c06f430 0x7fcd2c071940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcd440ae000 tx=0x7fcd440a7000 comp rx=0 tx=0).stop 2024-04-25T13:41:16.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48073bc0 msgr2=0x7fcd4813ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48073bc0 0x7fcd4813ee90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800c3c0 tx=0x7fcd3800c880 comp rx=0 tx=0).stop 2024-04-25T13:41:16.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 shutdown_connections 2024-04-25T13:41:16.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fcd2c06f430 0x7fcd2c071940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcd48146cb0 0x7fcd48138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcd480b85f0 0x7fcd48138a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 --2- 172.21.15.77:0/1069592690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd48073bc0 0x7fcd4813ee90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 >> 172.21.15.77:0/1069592690 conn(0x7fcd480c02a0 msgr2=0x7fcd4813cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:16.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 shutdown_connections 2024-04-25T13:41:16.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.251+0000 7fcd4f4d4640 1 -- 172.21.15.77:0/1069592690 wait complete. 2024-04-25T13:41:16.475 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:41:03.799479+0000', 'modified': '2024-04-25T13:41:06.824136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4261}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4261': {'gid': 4261, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.96:6833/1035589958', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6832', 'nonce': 1035589958}, {'type': 'v1', 'addr': '172.21.15.96:6833', 'nonce': 1035589958}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4261, 'qdb_cluster': [4261]} 2024-04-25T13:41:16.475 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T13:41:16.475 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T13:41:16.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe689073640 1 Processor -- start 2024-04-25T13:41:16.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe689073640 1 -- start start 2024-04-25T13:41:16.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe689073640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe68414fe10 0x7fe684072e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe689073640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6840741b0 con 0x7fe68406fba0 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe689073640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe684071b10 con 0x7fe6840733d0 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe689073640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe6840bfe40 con 0x7fe68414fe10 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe682d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe68406fba0 0x7fe68414f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59130/0 (socket says 172.21.15.77:59130) 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe682d9d640 1 -- 172.21.15.77:0/3241212515 learned_addr learned my addr 172.21.15.77:0/3241212515 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264762981 0 0) 0x7fe6840741b0 con 0x7fe68406fba0 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe66c003530 con 0x7fe68406fba0 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe68259c640 1 --2- 172.21.15.77:0/3241212515 >> v2:172.21.15.96:3300/0 conn(0x7fe68414fe10 0x7fe684072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 606472402 0 0) 0x7fe66c003530 con 0x7fe68406fba0 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 >> v2:172.21.15.96:3300/0 conn(0x7fe68414fe10 msgr2=0x7fe684072e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 --2- 172.21.15.77:0/3241212515 >> v2:172.21.15.96:3300/0 conn(0x7fe68414fe10 0x7fe684072e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 >> v1:172.21.15.96:6789/0 conn(0x7fe6840733d0 legacy=0x7fe6840737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68406ffb0 con 0x7fe68406fba0 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fe674001680 con 0x7fe68406fba0 2024-04-25T13:41:16.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 >> v1:172.21.15.77:6789/0 conn(0x7fe68406fba0 legacy=0x7fe68414f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003a30 0x7fe66c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe66c004810 0x7fe66c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe66c005360 0x7fe66c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6840bfe40 con 0x7fe66c005360 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c00c260 con 0x7fe66c003a30 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe66c00c460 con 0x7fe66c004810 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe68359e640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe66c005360 0x7fe66c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe682d9d640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003a30 0x7fe66c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe68259c640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe66c004810 0x7fe66c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe68359e640 1 -- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe66c004810 msgr2=0x7fe66c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe68359e640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe66c004810 0x7fe66c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe68359e640 1 -- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003a30 msgr2=0x7fe66c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe68359e640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003a30 0x7fe66c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe68359e640 1 -- 172.21.15.77:0/3241212515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c003530 con 0x7fe66c005360 2024-04-25T13:41:16.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe682d9d640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c003a30 0x7fe66c003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:16.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.631+0000 7fe68259c640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe66c004810 0x7fe66c004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe68359e640 1 -- 172.21.15.77:0/3241212515 reap_dead start 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe68359e640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe66c005360 0x7fe66c00b9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe67c001e40 tx=0x7fe67c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89a0116cb163242 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c001a90 con 0x7fe66c005360 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67c003b80 con 0x7fe66c005360 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe681d9b640 1 -- 172.21.15.77:0/3241212515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c005020 con 0x7fe66c005360 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe689073640 1 -- 172.21.15.77:0/3241212515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe66c005360 msgr2=0x7fe66c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe689073640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe66c005360 0x7fe66c00b9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe67c001e40 tx=0x7fe67c01c760 comp rx=0 tx=0).stop 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe689073640 1 -- 172.21.15.77:0/3241212515 shutdown_connections 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe689073640 1 --2- 172.21.15.77:0/3241212515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe66c005360 0x7fe66c00b9d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe689073640 1 -- 172.21.15.77:0/3241212515 >> 172.21.15.77:0/3241212515 conn(0x7fe6840c3cd0 msgr2=0x7fe6840c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:16.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe689073640 1 -- 172.21.15.77:0/3241212515 shutdown_connections 2024-04-25T13:41:16.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.635+0000 7fe689073640 1 -- 172.21.15.77:0/3241212515 wait complete. 2024-04-25T13:41:16.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 Processor -- start 2024-04-25T13:41:16.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 -- start start 2024-04-25T13:41:16.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c005360 0x7fe6841daf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684148650 0x7fe6841e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6841d7060 0x7fe6841d7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe684072e90 con 0x7fe684148650 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe6840a8cc0 con 0x7fe66c005360 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe684073010 con 0x7fe6841d7060 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684148650 0x7fe6841e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684148650 0x7fe6841e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42678/0 (socket says 172.21.15.77:42678) 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68259c640 1 -- 172.21.15.77:0/4045853570 learned_addr learned my addr 172.21.15.77:0/4045853570 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68359e640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6841d7060 0x7fe6841d7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe682d9d640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c005360 0x7fe6841daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68259c640 1 -- 172.21.15.77:0/4045853570 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6841d7060 msgr2=0x7fe6841d7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68259c640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6841d7060 0x7fe6841d7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68259c640 1 -- 172.21.15.77:0/4045853570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c005360 msgr2=0x7fe6841daf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68259c640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c005360 0x7fe6841daf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68259c640 1 -- 172.21.15.77:0/4045853570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6841d89c0 con 0x7fe684148650 2024-04-25T13:41:16.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe682d9d640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c005360 0x7fe6841daf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:16.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe68259c640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684148650 0x7fe6841e3d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe6780108d0 tx=0x7fe678010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe66b7fe640 1 -- 172.21.15.77:0/4045853570 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67800f040 con 0x7fe684148650 2024-04-25T13:41:16.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe66b7fe640 1 -- 172.21.15.77:0/4045853570 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67800eb60 con 0x7fe684148650 2024-04-25T13:41:16.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 -- 172.21.15.77:0/4045853570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6841d8ca0 con 0x7fe684148650 2024-04-25T13:41:16.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe66b7fe640 1 -- 172.21.15.77:0/4045853570 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67801c400 con 0x7fe684148650 2024-04-25T13:41:16.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.639+0000 7fe689073640 1 -- 172.21.15.77:0/4045853570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6841e4640 con 0x7fe684148650 2024-04-25T13:41:16.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe6903d0000 1 Processor -- start 2024-04-25T13:41:16.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe6903d0000 1 -- start start 2024-04-25T13:41:16.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe66b7fe640 1 -- 172.21.15.77:0/4045853570 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe67801c5a0 con 0x7fe684148650 2024-04-25T13:41:16.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe66b7fe640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe67006f430 0x7fe670071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe66b7fe640 1 -- 172.21.15.77:0/4045853570 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe67808f970 con 0x7fe684148650 2024-04-25T13:41:16.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68359e640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe67006f430 0x7fe670071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08ceddc20 0x55a08cff97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cec9ea0 0x55a08cff2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cac2280 0x55a08cff3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe6903d0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a08ceab160 con 0x55a08cec9ea0 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe6903d0000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55a08ce40e20 con 0x55a08ceddc20 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe6903d0000 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x55a08cdf9a20 con 0x55a08cac2280 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cec9ea0 0x55a08cff2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cec9ea0 0x55a08cff2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42680/0 (socket says 172.21.15.77:42680) 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68259c640 1 -- 172.21.15.77:0/619413172 learned_addr learned my addr 172.21.15.77:0/619413172 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68359e640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe67006f430 0x7fe670071940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00c230 tx=0x7fe67c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe682d9d640 1 --2- 172.21.15.77:0/619413172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08ceddc20 0x55a08cff97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68259c640 1 -- 172.21.15.77:0/619413172 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cac2280 msgr2=0x55a08cff3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68359e640 1 --2- 172.21.15.77:0/619413172 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cac2280 0x55a08cff3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68259c640 1 --2- 172.21.15.77:0/619413172 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cac2280 0x55a08cff3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68259c640 1 -- 172.21.15.77:0/619413172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08ceddc20 msgr2=0x55a08cff97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68259c640 1 --2- 172.21.15.77:0/619413172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08ceddc20 0x55a08cff97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68259c640 1 -- 172.21.15.77:0/619413172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a08cdfe100 con 0x55a08cec9ea0 2024-04-25T13:41:16.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe68259c640 1 --2- 172.21.15.77:0/619413172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cec9ea0 0x55a08cff2be0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe67808dec0 tx=0x7fe67805bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53320160a32a2354 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe668ff9640 1 -- 172.21.15.77:0/619413172 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67808c070 con 0x55a08cec9ea0 2024-04-25T13:41:16.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe668ff9640 1 -- 172.21.15.77:0/619413172 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67805c160 con 0x55a08cec9ea0 2024-04-25T13:41:16.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.643+0000 7fe668ff9640 1 -- 172.21.15.77:0/619413172 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe678075070 con 0x55a08cec9ea0 2024-04-25T13:41:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- 172.21.15.77:0/619413172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cec9ea0 msgr2=0x55a08cff2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 --2- 172.21.15.77:0/619413172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cec9ea0 0x55a08cff2be0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe67808dec0 tx=0x7fe67805bc70 comp rx=0 tx=0).stop 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- 172.21.15.77:0/619413172 shutdown_connections 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 --2- 172.21.15.77:0/619413172 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cac2280 0x55a08cff3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 --2- 172.21.15.77:0/619413172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cec9ea0 0x55a08cff2be0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 --2- 172.21.15.77:0/619413172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08ceddc20 0x55a08cff97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- 172.21.15.77:0/619413172 >> 172.21.15.77:0/619413172 conn(0x55a08cb01ff0 msgr2=0x55a08cff14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- 172.21.15.77:0/619413172 shutdown_connections 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- 172.21.15.77:0/619413172 wait complete. 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- start start 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 Processor -- start 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08cac2280 0x55a08cff8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08cffe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cffe600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a08ce4e220 con 0x55a08ceddc20 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55a08cde4ea0 con 0x55a08cac2280 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x55a08ce3bb00 con 0x55a08cec9ea0 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 10 client.0 _ll_register_callbacks cb 0x55a08ce4ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cffe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cffe600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42686/0 (socket says 172.21.15.77:42686) 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68359e640 1 -- 172.21.15.77:0/2387293748 learned_addr learned my addr 172.21.15.77:0/2387293748 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68259c640 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08cffe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe682d9d640 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08cac2280 0x55a08cff8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68359e640 1 -- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 msgr2=0x55a08cffe0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68359e640 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08cffe0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68359e640 1 -- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08cac2280 msgr2=0x55a08cff8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68359e640 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08cac2280 0x55a08cff8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68359e640 1 -- 172.21.15.77:0/2387293748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a08cde0500 con 0x55a08ceddc20 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe68359e640 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cffe600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe67c098170 tx=0x7fe67c019500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59efcb1db46e8f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe661ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe661ffb640 1 -- 172.21.15.77:0/2387293748 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0054f0 con 0x55a08ceddc20 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe661ffb640 1 -- 172.21.15.77:0/2387293748 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe67c005690 con 0x55a08ceddc20 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- 172.21.15.77:0/2387293748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe67805c160 con 0x55a08ceddc20 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe661ffb640 1 -- 172.21.15.77:0/2387293748 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe67c0a6460 con 0x55a08ceddc20 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 10 client.4605 fetch_fsmap learned FSMap version 7 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- 172.21.15.77:0/2387293748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55a08cdc6ea0 con 0x55a08ceddc20 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe661ffb640 1 -- 172.21.15.77:0/2387293748 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67805c160 con 0x55a08ceddc20 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe661ffb640 1 -- 172.21.15.77:0/2387293748 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 7) ==== 2284+0+0 (secure 0 0 0) 0x7fe67c0c8050 con 0x55a08ceddc20 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 10 client.4605 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 10 client.4605 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:41:16.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 20 client.4605 populate_metadata read hostname 'smithi077' 2024-04-25T13:41:16.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] conn(0x55a08cae67d0 0x55a08d035d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 4 client.4605 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:41:16.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe6903d0000 1 -- 172.21.15.77:0/2387293748 --> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a08cdd9be0 con 0x55a08cae67d0 2024-04-25T13:41:16.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.647+0000 7fe682d9d640 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] conn(0x55a08cae67d0 0x55a08d035d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe661ffb640 10 client.4605 ms_handle_connect on v2:172.21.15.96:6832/1035589958 2024-04-25T13:41:16.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe682d9d640 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] conn(0x55a08cae67d0 0x55a08d035d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cafe7b6ee6c5109 server_cookie=69a53f8399465b1f in_seq=0 out_seq=0 2024-04-25T13:41:16.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe661ffb640 1 -- 172.21.15.77:0/2387293748 <== mds.0 v2:172.21.15.96:6832/1035589958 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a08cdd9be0 con 0x55a08cae67d0 2024-04-25T13:41:16.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe661ffb640 10 client.4605 handle_command_reply: tid=0 2024-04-25T13:41:16.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 client.4605 shutdown 2024-04-25T13:41:16.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 -- 172.21.15.77:0/2387293748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 msgr2=0x55a08cffe600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cffe600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe67c098170 tx=0x7fe67c019500 comp rx=0 tx=0).stop 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 -- 172.21.15.77:0/2387293748 shutdown_connections 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] conn(0x55a08cae67d0 0x55a08d035d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cffe600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08cffe0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe661ffb640 0 client.4605 ms_handle_reset on v2:172.21.15.96:6832/1035589958 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2387293748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08cac2280 0x55a08cff8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 -- 172.21.15.77:0/2387293748 >> 172.21.15.77:0/2387293748 conn(0x55a08cb01ff0 msgr2=0x55a08cff1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 -- 172.21.15.77:0/2387293748 shutdown_connections 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 1 -- 172.21.15.77:0/2387293748 wait complete. 2024-04-25T13:41:16.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.651+0000 7fe6903d0000 20 client.4605 trim_cache size 0 max 16384 2024-04-25T13:41:16.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 Processor -- start 2024-04-25T13:41:16.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 -- start start 2024-04-25T13:41:16.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08cac2280 0x55a08d045ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08cff0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cff0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a08cff6bd0 con 0x55a08ceddc20 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841f0bf0 con 0x55a08cac2280 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe6841e7f00 con 0x55a08cec9ea0 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe68359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cff0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe68359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cff0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42696/0 (socket says 172.21.15.77:42696) 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe68359e640 1 -- 172.21.15.77:0/4247129296 learned_addr learned my addr 172.21.15.77:0/4247129296 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe68359e640 1 -- 172.21.15.77:0/4247129296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 msgr2=0x55a08cff0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe68359e640 1 --2- 172.21.15.77:0/4247129296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08cff0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe68359e640 1 -- 172.21.15.77:0/4247129296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08cac2280 msgr2=0x55a08d045ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe68359e640 1 --2- 172.21.15.77:0/4247129296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08cac2280 0x55a08d045ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe68359e640 1 -- 172.21.15.77:0/4247129296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a08cdf9c70 con 0x55a08ceddc20 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe68359e640 1 --2- 172.21.15.77:0/4247129296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cff0fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe67c007ea0 tx=0x7fe67c0bb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4382d259f57627dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe663fff640 1 -- 172.21.15.77:0/4247129296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0055c0 con 0x55a08ceddc20 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe663fff640 1 -- 172.21.15.77:0/4247129296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67c005760 con 0x55a08ceddc20 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe663fff640 1 -- 172.21.15.77:0/4247129296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c003bc0 con 0x55a08ceddc20 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 -- 172.21.15.77:0/4247129296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 msgr2=0x55a08cff0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 --2- 172.21.15.77:0/4247129296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cff0fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe67c007ea0 tx=0x7fe67c0bb000 comp rx=0 tx=0).stop 2024-04-25T13:41:16.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 -- 172.21.15.77:0/4247129296 shutdown_connections 2024-04-25T13:41:16.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 --2- 172.21.15.77:0/4247129296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08ceddc20 0x55a08cff0fd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 --2- 172.21.15.77:0/4247129296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08cff0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 --2- 172.21.15.77:0/4247129296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08cac2280 0x55a08d045ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 -- 172.21.15.77:0/4247129296 >> 172.21.15.77:0/4247129296 conn(0x55a08cb01ff0 msgr2=0x55a08cff4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:16.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 -- 172.21.15.77:0/4247129296 shutdown_connections 2024-04-25T13:41:16.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.671+0000 7fe6903d0000 1 -- 172.21.15.77:0/4247129296 wait complete. 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 -- start start 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 Processor -- start 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cac2280 0x55a08cff4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08d06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08ceddc20 0x55a08d06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a08ce40130 con 0x55a08cac2280 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55a08cdd67d0 con 0x55a08ceddc20 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x55a08ce45450 con 0x55a08cec9ea0 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 10 client.0 _ll_register_callbacks cb 0x7fe66c003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe682d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cac2280 0x55a08cff4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe682d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cac2280 0x55a08cff4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42712/0 (socket says 172.21.15.77:42712) 2024-04-25T13:41:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe682d9d640 1 -- 172.21.15.77:0/2235059704 learned_addr learned my addr 172.21.15.77:0/2235059704 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe682d9d640 1 -- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 msgr2=0x55a08d06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe682d9d640 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08d06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe682d9d640 1 -- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08ceddc20 msgr2=0x55a08d06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe682d9d640 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08ceddc20 0x55a08d06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe682d9d640 1 -- 172.21.15.77:0/2235059704 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a08cec3180 con 0x55a08cac2280 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe682d9d640 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cac2280 0x55a08cff4520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe674004880 tx=0x7fe67401b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd897100be92974 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe661ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe661ffb640 1 -- 172.21.15.77:0/2235059704 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674010040 con 0x55a08cac2280 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe661ffb640 1 -- 172.21.15.77:0/2235059704 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe674024950 con 0x55a08cac2280 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 -- 172.21.15.77:0/2235059704 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe67c005760 con 0x55a08cac2280 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe661ffb640 1 -- 172.21.15.77:0/2235059704 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe67402d070 con 0x55a08cac2280 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 10 client.4611 fetch_fsmap learned FSMap version 7 2024-04-25T13:41:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 -- 172.21.15.77:0/2235059704 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55a08cafa0c0 con 0x55a08cac2280 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe661ffb640 1 -- 172.21.15.77:0/2235059704 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67c005760 con 0x55a08cac2280 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe661ffb640 1 -- 172.21.15.77:0/2235059704 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 7) ==== 2284+0+0 (secure 0 0 0) 0x7fe674016050 con 0x55a08cac2280 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 10 client.4611 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 10 client.4611 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 20 client.4611 populate_metadata read hostname 'smithi077' 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] conn(0x55a08cad4830 0x55a08d0a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 4 client.4611 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe6903d0000 1 -- 172.21.15.77:0/2235059704 --> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] -- command(tid 0: {"prefix": "status"}) -- 0x55a08cff9ab0 con 0x55a08cad4830 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe68259c640 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] conn(0x55a08cad4830 0x55a08d0a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe68259c640 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] conn(0x55a08cad4830 0x55a08d0a1d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a97bd5eb5c46555 server_cookie=cc5e691e63186070 in_seq=0 out_seq=0 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.675+0000 7fe661ffb640 10 client.4611 ms_handle_connect on v2:172.21.15.96:6832/1035589958 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe661ffb640 1 -- 172.21.15.77:0/2235059704 <== mds.0 v2:172.21.15.96:6832/1035589958 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55a08cff9ab0 con 0x55a08cad4830 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe661ffb640 10 client.4611 handle_command_reply: tid=0 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 client.4611 shutdown 2024-04-25T13:41:16.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 -- 172.21.15.77:0/2235059704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cac2280 msgr2=0x55a08cff4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cac2280 0x55a08cff4520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe674004880 tx=0x7fe67401b840 comp rx=0 tx=0).stop 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 -- 172.21.15.77:0/2235059704 shutdown_connections 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55a08ceddc20 0x55a08d06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55a08cec9ea0 0x55a08d06a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.96:6832/1035589958,v1:172.21.15.96:6833/1035589958] conn(0x55a08cad4830 0x55a08d0a1d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 --2- 172.21.15.77:0/2235059704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a08cac2280 0x55a08cff4520 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe661ffb640 0 client.4611 ms_handle_reset on v2:172.21.15.96:6832/1035589958 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 -- 172.21.15.77:0/2235059704 >> 172.21.15.77:0/2235059704 conn(0x55a08cb01ff0 msgr2=0x55a08d044fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 -- 172.21.15.77:0/2235059704 shutdown_connections 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 1 -- 172.21.15.77:0/2235059704 wait complete. 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe6903d0000 20 client.4611 trim_cache size 0 max 16384 2024-04-25T13:41:16.683 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "137a8595-336b-48a1-94de-86eaa6851f1a", 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4261, 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 12.294571158, 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 7, 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 21, 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 21, 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 19.588553663999999 2024-04-25T13:41:16.684 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T13:41:16.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 -- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe67006f430 msgr2=0x7fe670071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe67006f430 0x7fe670071940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00c230 tx=0x7fe67c009040 comp rx=0 tx=0).stop 2024-04-25T13:41:16.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 -- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684148650 msgr2=0x7fe6841e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:16.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684148650 0x7fe6841e3d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe6780108d0 tx=0x7fe678010d90 comp rx=0 tx=0).stop 2024-04-25T13:41:16.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 -- 172.21.15.77:0/4045853570 shutdown_connections 2024-04-25T13:41:16.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe67006f430 0x7fe670071940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6841d7060 0x7fe6841d7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684148650 0x7fe6841e3d40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 --2- 172.21.15.77:0/4045853570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe66c005360 0x7fe6841daf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:16.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 -- 172.21.15.77:0/4045853570 >> 172.21.15.77:0/4045853570 conn(0x7fe6840c3cd0 msgr2=0x7fe6840c2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:16.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 -- 172.21.15.77:0/4045853570 shutdown_connections 2024-04-25T13:41:16.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:16.679+0000 7fe689073640 1 -- 172.21.15.77:0/4045853570 wait complete. 2024-04-25T13:41:16.699 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T13:41:16.707 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T13:41:16.707 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T13:41:16.708 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T13:41:16.708 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T13:41:16.730 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T13:41:16.730 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}, 'client.2': {}} 2024-04-25T13:41:16.730 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T13:41:16.730 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:41:16.730 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:41:16.730 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-25T13:41:16.730 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:41:16.731 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T13:41:16.731 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-25T13:41:16.731 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:41:16.731 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T13:41:16.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:16.731 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-04-25T13:41:16.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:16.738 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2024-04-25T13:41:16.797 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2024-04-25T13:41:16.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:16.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:16.799 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2024-04-25T13:41:16.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:16.805 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2024-04-25T13:41:16.865 INFO:teuthology.orchestra.run.smithi097.stderr:Cannot find device "ceph-brx" 2024-04-25T13:41:16.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:16.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:16.867 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-04-25T13:41:16.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:16.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2024-04-25T13:41:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2024-04-25T13:41:16.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:16.935 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T13:41:16.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:41:17.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f935250e640 1 Processor -- start 2024-04-25T13:41:17.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f935250e640 1 -- start start 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f935250e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c0b85f0 0x7f934c146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f935250e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f934c073bc0 0x7f934c073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f935250e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934c074510 con 0x7f934c071900 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f935250e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f934c071d10 con 0x7f934c073bc0 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f935250e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f934c150ff0 con 0x7f934c0b85f0 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f934c071900 0x7f934c06f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59136/0 (socket says 172.21.15.77:59136) 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934b7fe640 1 -- 172.21.15.77:0/1053398727 learned_addr learned my addr 172.21.15.77:0/1053398727 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f9350aab640 1 --2- 172.21.15.77:0/1053398727 >> v2:172.21.15.96:3300/0 conn(0x7f934c073bc0 0x7f934c073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934bfff640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c0b85f0 0x7f934c146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394905077 0 0) 0x7f934c074510 con 0x7f934c071900 2024-04-25T13:41:17.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9334003530 con 0x7f934c071900 2024-04-25T13:41:17.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3835973426 0 0) 0x7f9334003530 con 0x7f934c071900 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c0b85f0 msgr2=0x7f934c146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c0b85f0 0x7f934c146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 >> v2:172.21.15.96:3300/0 conn(0x7f934c073bc0 msgr2=0x7f934c073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 --2- 172.21.15.77:0/1053398727 >> v2:172.21.15.96:3300/0 conn(0x7f934c073bc0 0x7f934c073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c0733c0 con 0x7f934c071900 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f9340001680 con 0x7f934c071900 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 >> v1:172.21.15.77:6789/0 conn(0x7f934c071900 legacy=0x7f934c06f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f9334003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c0b85f0 0x7f9334004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9334004d50 0x7f9334005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f934c071d10 con 0x7f93340039c0 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f934c150ff0 con 0x7f9334004d50 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.087+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f933400ba50 con 0x7f934c0b85f0 2024-04-25T13:41:17.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934bfff640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f9334003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934b7fe640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c0b85f0 0x7f9334004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934bfff640 1 -- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c0b85f0 msgr2=0x7f9334004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:17.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934bfff640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c0b85f0 0x7f9334004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f9350aab640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9334004d50 0x7f9334005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934bfff640 1 -- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9334004d50 msgr2=0x7f9334005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:17.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934bfff640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9334004d50 0x7f9334005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934bfff640 1 -- 172.21.15.77:0/1053398727 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9334003530 con 0x7f93340039c0 2024-04-25T13:41:17.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934b7fe640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c0b85f0 0x7f9334004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:17.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934bfff640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f9334003e30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f934c0c1370 tx=0x7f933c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f5a115cc724ba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:17.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c009690 con 0x7f93340039c0 2024-04-25T13:41:17.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933c0059a0 con 0x7f93340039c0 2024-04-25T13:41:17.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f934affd640 1 -- 172.21.15.77:0/1053398727 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c005d50 con 0x7f93340039c0 2024-04-25T13:41:17.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f935250e640 1 -- 172.21.15.77:0/1053398727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 msgr2=0x7f9334003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:17.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f935250e640 1 --2- 172.21.15.77:0/1053398727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f9334003e30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f934c0c1370 tx=0x7f933c01c9e0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f9350aab640 1 -- 172.21.15.77:0/1053398727 reap_dead start 2024-04-25T13:41:17.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f935250e640 1 -- 172.21.15.77:0/1053398727 shutdown_connections 2024-04-25T13:41:17.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f935250e640 1 -- 172.21.15.77:0/1053398727 >> 172.21.15.77:0/1053398727 conn(0x7f934c0c02a0 msgr2=0x7f934c0c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:17.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f935250e640 1 -- 172.21.15.77:0/1053398727 shutdown_connections 2024-04-25T13:41:17.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.091+0000 7f935250e640 1 -- 172.21.15.77:0/1053398727 wait complete. 2024-04-25T13:41:17.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 Processor -- start 2024-04-25T13:41:17.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 -- start start 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f934c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c152ee0 0x7f934c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f934c140620 0x7f934c14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f934c15b530 con 0x7f93340039c0 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f934c15b3b0 con 0x7f934c140620 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f934c15b6b0 con 0x7f934c152ee0 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f934c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f934c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42728/0 (socket says 172.21.15.77:42728) 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934bfff640 1 -- 172.21.15.77:0/2535304203 learned_addr learned my addr 172.21.15.77:0/2535304203 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f9350aab640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f934c140620 0x7f934c14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934b7fe640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c152ee0 0x7f934c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934bfff640 1 -- 172.21.15.77:0/2535304203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c152ee0 msgr2=0x7f934c156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934bfff640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c152ee0 0x7f934c156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934bfff640 1 -- 172.21.15.77:0/2535304203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f934c140620 msgr2=0x7f934c14cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934bfff640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f934c140620 0x7f934c14cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934bfff640 1 -- 172.21.15.77:0/2535304203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c152a00 con 0x7f93340039c0 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f9350aab640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f934c140620 0x7f934c14cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f934bfff640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f934c1536f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c10 tx=0x7f9334005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f9348ff9640 1 -- 172.21.15.77:0/2535304203 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c0be070 con 0x7f93340039c0 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f9348ff9640 1 -- 172.21.15.77:0/2535304203 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933c006030 con 0x7f93340039c0 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c1519d0 con 0x7f93340039c0 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f9348ff9640 1 -- 172.21.15.77:0/2535304203 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c006420 con 0x7f93340039c0 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.095+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c159b60 con 0x7f93340039c0 2024-04-25T13:41:17.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.099+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c06a280 con 0x7f93340039c0 2024-04-25T13:41:17.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.099+0000 7f9348ff9640 1 -- 172.21.15.77:0/2535304203 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f933c0c1070 con 0x7f93340039c0 2024-04-25T13:41:17.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.099+0000 7f9348ff9640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f933806f400 0x7f9338071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.099+0000 7f934b7fe640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f933806f400 0x7f9338071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.099+0000 7f9348ff9640 1 -- 172.21.15.77:0/2535304203 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f933c128a80 con 0x7f93340039c0 2024-04-25T13:41:17.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.099+0000 7f934b7fe640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f933806f400 0x7f9338071910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9340001850 tx=0x7f9340009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:17.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.103+0000 7f9348ff9640 1 -- 172.21.15.77:0/2535304203 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f933c016720 con 0x7f93340039c0 2024-04-25T13:41:17.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f934c144bf0 con 0x7f93340039c0 2024-04-25T13:41:17.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f9348ff9640 1 -- 172.21.15.77:0/2535304203 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f933c0f5a00 con 0x7f93340039c0 2024-04-25T13:41:17.288 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T13:41:17.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f933806f400 msgr2=0x7f9338071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f933806f400 0x7f9338071910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9340001850 tx=0x7f9340009040 comp rx=0 tx=0).stop 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 msgr2=0x7f934c1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f934c1536f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c10 tx=0x7f9334005840 comp rx=0 tx=0).stop 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 shutdown_connections 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f933806f400 0x7f9338071910 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f934c140620 0x7f934c14cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f934c152ee0 0x7f934c156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 --2- 172.21.15.77:0/2535304203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93340039c0 0x7f934c1536f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 >> 172.21.15.77:0/2535304203 conn(0x7f934c0c02a0 msgr2=0x7f934c0756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 shutdown_connections 2024-04-25T13:41:17.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:17.287+0000 7f935250e640 1 -- 172.21.15.77:0/2535304203 wait complete. 2024-04-25T13:41:17.308 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:41:17.309 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:41:17.309 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2024-04-25T13:41:17.309 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T13:41:17.309 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:41:17.309 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:41:17.309 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:41:17.309 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:41:17.309 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:41:17.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:17.309 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2024-04-25T13:41:17.315 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:41:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42473sec preferred_lft 42473sec 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:81:d8:94:1d brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T13:41:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:17.317 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:41:17.318 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:17.318 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-04-25T13:41:17.318 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:41:17.318 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr flush dev ceph-brx 2024-04-25T13:41:17.318 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set ceph-brx up 2024-04-25T13:41:17.318 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:41:17.318 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-04-25T13:41:17.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:17.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:17.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:17.447 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:41:17.455 INFO:teuthology.orchestra.run.smithi097.stdout:1 2024-04-25T13:41:17.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:17.457 DEBUG:teuthology.orchestra.run.smithi097:> route 2024-04-25T13:41:17.539 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2024-04-25T13:41:17.539 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:41:17.539 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T13:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T13:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T13:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:41:17.540 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:41:17.540 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:17.540 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-04-25T13:41:17.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:41:17.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:41:17.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:41:17.541 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-04-25T13:41:17.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:17.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:17.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:17.657 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2024-04-25T13:41:17.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:17.663 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list-id 2024-04-25T13:41:17.709 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:17.709 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-04-25T13:41:17.709 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:41:17.709 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T13:41:17.709 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-04-25T13:41:17.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:17.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:17.825 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T13:41:17.825 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:17.825 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-04-25T13:41:17.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T13:41:17.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:41:17.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T13:41:17.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T13:41:17.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T13:41:17.826 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-04-25T13:41:17.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:17.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:17.919 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:17.919 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2024-04-25T13:41:17.919 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2024-04-25T13:41:17.919 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:41:17.919 DEBUG:teuthology.orchestra.run.smithi097:> ') 2024-04-25T13:41:17.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:18.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:18.021 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T13:41:18.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:41:18.021 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T13:41:18.068 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:41:18.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:41:18.069 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:41:18.116 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2024-04-25T13:41:18.174 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:41:18.222 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2024-04-25T13:41:18.222 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2024-04-25T13:41:18.222 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2024-04-25T13:41:18.222 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/run/lock 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/bpf 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/fs/nfsd 2024-04-25T13:41:18.223 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2024-04-25T13:41:18.224 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2024-04-25T13:41:18.224 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:41:18.224 INFO:teuthology.orchestra.run.smithi097.stdout:/run/rpc_pipefs 2024-04-25T13:41:18.224 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2024-04-25T13:41:18.224 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2024-04-25T13:41:18.224 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2024-04-25T13:41:18.224 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:41:18.224 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:41:18.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:18.225 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2024-04-25T13:41:18.273 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:41:18.273 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T13:41:18.318 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2024-04-25T13:41:18.333 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:41:18.385 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/run/lock 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/bpf 2024-04-25T13:41:18.386 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/fs/nfsd 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/run/rpc_pipefs 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:41:18.387 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:41:18.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:18.388 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2024-04-25T13:41:18.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:2024-04-25T13:41:18.449+0000 7f9c59c66580 -1 init, newargv = 0x7f9c4801b4e0 newargc=15 2024-04-25T13:41:18.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:ceph-fuse[22906]: starting ceph client 2024-04-25T13:41:18.460 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:ceph-fuse[22906]: starting fuse 2024-04-25T13:41:19.538 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2024-04-25T13:41:19.554 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:41:19.602 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2024-04-25T13:41:19.602 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/run/lock 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/bpf 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2024-04-25T13:41:19.603 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/fs/nfsd 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/run/rpc_pipefs 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:41:19.604 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T13:41:19.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:19.605 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2024-04-25T13:41:19.653 INFO:teuthology.orchestra.run.smithi097.stdout:45 2024-04-25T13:41:19.653 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> import glob 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> import re 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> import os 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> import subprocess 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> def _find_admin_socket(client_name): 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> files = glob.glob(asok_path) 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> # Given a non-glob path, it better be there 2024-04-25T13:41:19.654 DEBUG:teuthology.orchestra.run.smithi097:> if "*" not in asok_path: 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> assert(len(files) == 1) 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> return files[0] 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> for f in files: 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> contents = proc_f.read() 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> if mountpoint in contents: 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> return f 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> print(_find_admin_socket("client.0")) 2024-04-25T13:41:19.655 DEBUG:teuthology.orchestra.run.smithi097:> ' 2024-04-25T13:41:19.778 INFO:teuthology.orchestra.run.smithi097.stdout:/var/run/ceph/ceph-client.0.22906.asok 2024-04-25T13:41:19.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25T13:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:19.790 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.22906.asok 2024-04-25T13:41:19.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:19.790 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.22906.asok status 2024-04-25T13:41:19.970 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-25T13:41:19.970 INFO:teuthology.orchestra.run.smithi097.stdout: "metadata": { 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "entity_id": "0", 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "hostname": "smithi097", 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "pid": "22906", 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "root": "/" 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_count": 0, 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_pinned_count": 0, 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4448, 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "inst": { 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "name": { 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "client", 2024-04-25T13:41:19.971 INFO:teuthology.orchestra.run.smithi097.stdout: "num": 4448 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:0", 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 8205 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:0", 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 8205 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "inst_str": "client.4448 172.21.15.97:0/8205", 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "addr_str": "172.21.15.97:0/8205", 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "inode_count": 1, 2024-04-25T13:41:19.972 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_epoch": 7, 2024-04-25T13:41:19.973 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch": 21, 2024-04-25T13:41:19.973 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:41:19.973 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklisted": false, 2024-04-25T13:41:19.973 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs" 2024-04-25T13:41:19.973 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-25T13:41:19.986 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:41:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15c1030640 1 Processor -- start 2024-04-25T13:41:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15c1030640 1 -- start start 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15c1030640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc0a5da0 0x7f15bc06f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15c1030640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15bc06fdf0 0x7f15bc1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15c1030640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc0a8900 con 0x7f15bc152c00 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15c1030640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f15bc074770 con 0x7f15bc06fdf0 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15c1030640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc150100 con 0x7f15bc0a5da0 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15bb59e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f15bc152c00 0x7f15bc14e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59150/0 (socket says 172.21.15.77:59150) 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15bb59e640 1 -- 172.21.15.77:0/275693863 learned_addr learned my addr 172.21.15.77:0/275693863 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15ba59c640 1 --2- 172.21.15.77:0/275693863 >> v2:172.21.15.96:3300/0 conn(0x7f15bc06fdf0 0x7f15bc1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15bad9d640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc0a5da0 0x7f15bc06f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237885181 0 0) 0x7f15bc0a8900 con 0x7f15bc152c00 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a4003530 con 0x7f15bc152c00 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2046621301 0 0) 0x7f15a4003530 con 0x7f15bc152c00 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc0a5da0 msgr2=0x7f15bc06f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc0a5da0 0x7f15bc06f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 >> v2:172.21.15.96:3300/0 conn(0x7f15bc06fdf0 msgr2=0x7f15bc1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 --2- 172.21.15.77:0/275693863 >> v2:172.21.15.96:3300/0 conn(0x7f15bc06fdf0 0x7f15bc1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc0a8ba0 con 0x7f15bc152c00 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f15b4001a20 con 0x7f15bc152c00 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 >> v1:172.21.15.77:6789/0 conn(0x7f15bc152c00 legacy=0x7f15bc14e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc0a5da0 0x7f15a40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a4003f40 0x7f15a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15a4004d50 0x7f15a4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc074770 con 0x7f15a4004d50 2024-04-25T13:41:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc150100 con 0x7f15a4003f40 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f15a400bad0 con 0x7f15bc0a5da0 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.142+0000 7f15bb59e640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15a4004d50 0x7f15a4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15ba59c640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a4003f40 0x7f15a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15bad9d640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc0a5da0 0x7f15a40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15bb59e640 1 -- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc0a5da0 msgr2=0x7f15a40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15bb59e640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc0a5da0 0x7f15a40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15bb59e640 1 -- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a4003f40 msgr2=0x7f15a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15bb59e640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a4003f40 0x7f15a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15bb59e640 1 -- 172.21.15.77:0/275693863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a4003530 con 0x7f15a4004d50 2024-04-25T13:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15ba59c640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a4003f40 0x7f15a4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15bb59e640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15a4004d50 0x7f15a4005160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0a8ad0 tx=0x7f15b401fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70b021c6b46f0de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b400a4e0 con 0x7f15a4004d50 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b40aa710 con 0x7f15a4004d50 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15b9d9b640 1 -- 172.21.15.77:0/275693863 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b40aab00 con 0x7f15a4004d50 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15c1030640 1 -- 172.21.15.77:0/275693863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15a4004d50 msgr2=0x7f15a4005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15c1030640 1 --2- 172.21.15.77:0/275693863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15a4004d50 0x7f15a4005160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0a8ad0 tx=0x7f15b401fac0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15bb59e640 1 -- 172.21.15.77:0/275693863 reap_dead start 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15c1030640 1 -- 172.21.15.77:0/275693863 shutdown_connections 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15c1030640 1 -- 172.21.15.77:0/275693863 >> 172.21.15.77:0/275693863 conn(0x7f15bc0c02a0 msgr2=0x7f15bc0c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15c1030640 1 -- 172.21.15.77:0/275693863 shutdown_connections 2024-04-25T13:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.146+0000 7f15c1030640 1 -- 172.21.15.77:0/275693863 wait complete. 2024-04-25T13:41:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 Processor -- start 2024-04-25T13:41:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 -- start start 2024-04-25T13:41:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc1e6b00 0x7f15bc1dada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15bc1db2e0 0x7f15bc144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15bc144880 0x7f15bc147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc06f8b0 con 0x7f15bc1db2e0 2024-04-25T13:41:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0a7ee0 con 0x7f15bc144880 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc06fa30 con 0x7f15bc1e6b00 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15ba59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15bc1db2e0 0x7f15bc144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15ba59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15bc1db2e0 0x7f15bc144340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42748/0 (socket says 172.21.15.77:42748) 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15ba59c640 1 -- 172.21.15.77:0/3057378974 learned_addr learned my addr 172.21.15.77:0/3057378974 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15bad9d640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc1e6b00 0x7f15bc1dada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15bb59e640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15bc144880 0x7f15bc147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15ba59c640 1 -- 172.21.15.77:0/3057378974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc1e6b00 msgr2=0x7f15bc1dada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15ba59c640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc1e6b00 0x7f15bc1dada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15ba59c640 1 -- 172.21.15.77:0/3057378974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15bc144880 msgr2=0x7f15bc147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15ba59c640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15bc144880 0x7f15bc147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15ba59c640 1 -- 172.21.15.77:0/3057378974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc1e7020 con 0x7f15bc1db2e0 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15ba59c640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15bc1db2e0 0x7f15bc144340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f15b0010860 tx=0x7f15b0010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15a37fe640 1 -- 172.21.15.77:0/3057378974 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b000f040 con 0x7f15bc1db2e0 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15a37fe640 1 -- 172.21.15.77:0/3057378974 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b0004220 con 0x7f15bc1db2e0 2024-04-25T13:41:20.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc1479d0 con 0x7f15bc1db2e0 2024-04-25T13:41:20.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15a37fe640 1 -- 172.21.15.77:0/3057378974 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b0010e50 con 0x7f15bc1db2e0 2024-04-25T13:41:20.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.150+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15bc1d8500 con 0x7f15bc1db2e0 2024-04-25T13:41:20.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.154+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc1e71f0 con 0x7f15bc1db2e0 2024-04-25T13:41:20.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.154+0000 7f15a37fe640 1 -- 172.21.15.77:0/3057378974 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f15b000e960 con 0x7f15bc1db2e0 2024-04-25T13:41:20.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.154+0000 7f15a37fe640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f15a806f400 0x7f15a8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.154+0000 7f15bad9d640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f15a806f400 0x7f15a8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.154+0000 7f15a37fe640 1 -- 172.21.15.77:0/3057378974 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f15b008f4a0 con 0x7f15bc1db2e0 2024-04-25T13:41:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.154+0000 7f15bad9d640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f15a806f400 0x7f15a8071910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15bc149560 tx=0x7f15ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:20.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.158+0000 7f15a37fe640 1 -- 172.21.15.77:0/3057378974 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f15b0018030 con 0x7f15bc1db2e0 2024-04-25T13:41:20.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.354+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f15bc1477d0 con 0x7f15bc1db2e0 2024-04-25T13:41:20.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15a37fe640 1 -- 172.21.15.77:0/3057378974 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f15b005c420 con 0x7f15bc1db2e0 2024-04-25T13:41:20.359 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T13:41:20.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f15a806f400 msgr2=0x7f15a8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:20.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f15a806f400 0x7f15a8071910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15bc149560 tx=0x7f15ac008040 comp rx=0 tx=0).stop 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15bc1db2e0 msgr2=0x7f15bc144340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15bc1db2e0 0x7f15bc144340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f15b0010860 tx=0x7f15b0010d20 comp rx=0 tx=0).stop 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 shutdown_connections 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f15a806f400 0x7f15a8071910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15bc144880 0x7f15bc147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15bc1db2e0 0x7f15bc144340 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 --2- 172.21.15.77:0/3057378974 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15bc1e6b00 0x7f15bc1dada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 >> 172.21.15.77:0/3057378974 conn(0x7f15bc0c02a0 msgr2=0x7f15bc0c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 shutdown_connections 2024-04-25T13:41:20.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:20.358+0000 7f15c1030640 1 -- 172.21.15.77:0/3057378974 wait complete. 2024-04-25T13:41:20.380 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:41:20.380 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:41:20.380 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2024-04-25T13:41:20.380 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T13:41:20.381 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T13:41:20.381 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:41:20.381 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:41:20.381 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:41:20.381 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T13:41:20.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:20.381 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2024-04-25T13:41:20.388 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42473sec preferred_lft 42473sec 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 02:42:77:8c:65:5f brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T13:41:20.389 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:20.389 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:41:20.389 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:20.389 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-04-25T13:41:20.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:41:20.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2024-04-25T13:41:20.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2024-04-25T13:41:20.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:41:20.390 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-04-25T13:41:20.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:20.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:20.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:20.519 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:41:20.528 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-04-25T13:41:20.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:20.529 DEBUG:teuthology.orchestra.run.smithi151:> route 2024-04-25T13:41:20.601 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2024-04-25T13:41:20.601 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:41:20.601 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T13:41:20.601 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:41:20.601 INFO:teuthology.orchestra.run.smithi151.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T13:41:20.601 INFO:teuthology.orchestra.run.smithi151.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T13:41:20.601 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:41:20.602 INFO:teuthology.orchestra.run.smithi151.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:41:20.602 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:41:20.602 INFO:teuthology.orchestra.run.smithi151.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:41:20.602 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:41:20.602 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:20.602 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-04-25T13:41:20.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:41:20.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:41:20.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:41:20.602 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-04-25T13:41:20.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:20.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:20.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:20.725 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-04-25T13:41:20.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:20.731 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2024-04-25T13:41:20.777 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:20.778 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-04-25T13:41:20.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:41:20.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T13:41:20.778 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-04-25T13:41:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:20.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:20.894 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T13:41:20.895 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:20.895 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-04-25T13:41:20.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T13:41:20.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:41:20.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T13:41:20.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T13:41:20.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T13:41:20.895 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-04-25T13:41:20.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:20.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:20.999 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:20.999 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-04-25T13:41:20.999 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2024-04-25T13:41:20.999 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:41:20.999 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-04-25T13:41:21.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:21.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:21.104 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-25T13:41:21.104 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:41:21.104 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T13:41:21.149 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T13:41:21.149 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:41:21.149 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T13:41:21.197 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2024-04-25T13:41:21.254 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/run/lock 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2024-04-25T13:41:21.303 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/bpf 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/fs/nfsd 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/run/rpc_pipefs 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2024-04-25T13:41:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:41:21.305 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:41:21.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:21.306 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2024-04-25T13:41:21.354 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:41:21.354 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-25T13:41:21.399 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2024-04-25T13:41:21.413 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:41:21.462 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2024-04-25T13:41:21.462 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2024-04-25T13:41:21.462 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2024-04-25T13:41:21.462 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/run/lock 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/bpf 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2024-04-25T13:41:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/fs/nfsd 2024-04-25T13:41:21.464 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2024-04-25T13:41:21.464 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2024-04-25T13:41:21.464 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:41:21.464 INFO:teuthology.orchestra.run.smithi151.stdout:/run/rpc_pipefs 2024-04-25T13:41:21.464 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2024-04-25T13:41:21.464 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2024-04-25T13:41:21.464 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2024-04-25T13:41:21.464 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:41:21.464 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:41:21.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:21.465 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2024-04-25T13:41:21.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:2024-04-25T13:41:21.519+0000 7ff206129580 -1 init, newargv = 0x7ff1f401b2d0 newargc=15 2024-04-25T13:41:21.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:ceph-fuse[22883]: starting ceph client 2024-04-25T13:41:21.534 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:ceph-fuse[22883]: starting fuse 2024-04-25T13:41:22.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2024-04-25T13:41:22.631 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/run/lock 2024-04-25T13:41:22.679 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/bpf 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/fs/nfsd 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/run/rpc_pipefs 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2024-04-25T13:41:22.680 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2024-04-25T13:41:22.681 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:41:22.681 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:41:22.681 INFO:teuthology.orchestra.run.smithi151.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-25T13:41:22.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:22.682 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2024-04-25T13:41:22.730 INFO:teuthology.orchestra.run.smithi151.stdout:45 2024-04-25T13:41:22.730 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> import glob 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> import re 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> import os 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> import subprocess 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> def _find_admin_socket(client_name): 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> files = glob.glob(asok_path) 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> 2024-04-25T13:41:22.731 DEBUG:teuthology.orchestra.run.smithi151:> # Given a non-glob path, it better be there 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> if "*" not in asok_path: 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> assert(len(files) == 1) 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> return files[0] 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> for f in files: 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> contents = proc_f.read() 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> if mountpoint in contents: 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> return f 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> print(_find_admin_socket("client.1")) 2024-04-25T13:41:22.732 DEBUG:teuthology.orchestra.run.smithi151:> ' 2024-04-25T13:41:22.855 INFO:teuthology.orchestra.run.smithi151.stdout:/var/run/ceph/ceph-client.1.22883.asok 2024-04-25T13:41:22.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T13:41:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:22.866 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.22883.asok 2024-04-25T13:41:22.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:22.866 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.22883.asok status 2024-04-25T13:41:23.041 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-04-25T13:41:23.041 INFO:teuthology.orchestra.run.smithi151.stdout: "metadata": { 2024-04-25T13:41:23.041 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "entity_id": "1", 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": "smithi151", 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "pid": "22883", 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "root": "/" 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_count": 0, 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_pinned_count": 0, 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4638, 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "inst": { 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "name": { 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "client", 2024-04-25T13:41:23.042 INFO:teuthology.orchestra.run.smithi151.stdout: "num": 4638 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 1772324777 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 1772324777 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "inst_str": "client.4638 172.21.15.151:0/1772324777", 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "addr_str": "172.21.15.151:0/1772324777", 2024-04-25T13:41:23.043 INFO:teuthology.orchestra.run.smithi151.stdout: "inode_count": 1, 2024-04-25T13:41:23.044 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_epoch": 7, 2024-04-25T13:41:23.044 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch": 21, 2024-04-25T13:41:23.044 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:41:23.044 INFO:teuthology.orchestra.run.smithi151.stdout: "blocklisted": false, 2024-04-25T13:41:23.044 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs" 2024-04-25T13:41:23.044 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-04-25T13:41:23.057 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:41:23.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f563d492640 1 Processor -- start 2024-04-25T13:41:23.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f563d492640 1 -- start start 2024-04-25T13:41:23.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f563d492640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5638153220 0x7f56380ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:23.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f563d492640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5638152360 con 0x7f56380c6970 2024-04-25T13:41:23.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f563d492640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56380c4d10 con 0x7f56380a6960 2024-04-25T13:41:23.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f563d492640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f56380c6d80 con 0x7f5638153220 2024-04-25T13:41:23.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f56377fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5638153220 0x7f56380ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:23.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f56377fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5638153220 0x7f56380ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37566/0 (socket says 172.21.15.77:37566) 2024-04-25T13:41:23.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f56377fe640 1 -- 172.21.15.77:0/3305016532 learned_addr learned my addr 172.21.15.77:0/3305016532 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:23.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f56367fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f56380c6970 0x7f5638152b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47204/0 (socket says 172.21.15.77:47204) 2024-04-25T13:41:23.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f56377fe640 1 -- 172.21.15.77:0/3305016532 >> v1:172.21.15.96:6789/0 conn(0x7f56380a6960 legacy=0x7f56380c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:23.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f56377fe640 1 -- 172.21.15.77:0/3305016532 >> v1:172.21.15.77:6789/0 conn(0x7f56380c6970 legacy=0x7f5638152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:23.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f56377fe640 1 -- 172.21.15.77:0/3305016532 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56380c8480 con 0x7f5638153220 2024-04-25T13:41:23.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.214+0000 7f5635ffb640 1 -- 172.21.15.77:0/3305016532 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764834012 0 0) 0x7f5638152360 con 0x7f56380c6970 2024-04-25T13:41:23.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f56377fe640 1 --2- 172.21.15.77:0/3305016532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 0x7f56380ad2e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f56280098a0 tx=0x7f562801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35db9b66f23297e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:23.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f5635ffb640 1 -- 172.21.15.77:0/3305016532 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280ab610 con 0x7f5638153220 2024-04-25T13:41:23.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f5635ffb640 1 -- 172.21.15.77:0/3305016532 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56280b0070 con 0x7f5638153220 2024-04-25T13:41:23.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f5635ffb640 1 -- 172.21.15.77:0/3305016532 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280ab9d0 con 0x7f5638153220 2024-04-25T13:41:23.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f563d492640 1 -- 172.21.15.77:0/3305016532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 msgr2=0x7f56380ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:23.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f563d492640 1 --2- 172.21.15.77:0/3305016532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 0x7f56380ad2e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f56280098a0 tx=0x7f562801c500 comp rx=0 tx=0).stop 2024-04-25T13:41:23.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f563d492640 1 -- 172.21.15.77:0/3305016532 shutdown_connections 2024-04-25T13:41:23.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f563d492640 1 --2- 172.21.15.77:0/3305016532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 0x7f56380ad2e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f563d492640 1 -- 172.21.15.77:0/3305016532 >> 172.21.15.77:0/3305016532 conn(0x7f563806ded0 msgr2=0x7f563806e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:23.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f563d492640 1 -- 172.21.15.77:0/3305016532 shutdown_connections 2024-04-25T13:41:23.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.218+0000 7f563d492640 1 -- 172.21.15.77:0/3305016532 wait complete. 2024-04-25T13:41:23.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 Processor -- start 2024-04-25T13:41:23.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 -- start start 2024-04-25T13:41:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56380a6960 0x7f56381eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56380c6970 0x7f56380a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 0x7f56381ef3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5638160de0 con 0x7f5638153220 2024-04-25T13:41:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5638152680 con 0x7f56380c6970 2024-04-25T13:41:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f5638160f60 con 0x7f56380a6960 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 0x7f56381ef3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 0x7f56381ef3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37572/0 (socket says 172.21.15.77:37572) 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56377fe640 1 -- 172.21.15.77:0/927898027 learned_addr learned my addr 172.21.15.77:0/927898027 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56367fc640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56380c6970 0x7f56380a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f5636ffd640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56380a6960 0x7f56381eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56377fe640 1 -- 172.21.15.77:0/927898027 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56380a6960 msgr2=0x7f56381eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56377fe640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56380a6960 0x7f56381eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56377fe640 1 -- 172.21.15.77:0/927898027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56380c6970 msgr2=0x7f56380a7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56377fe640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56380c6970 0x7f56380a7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56377fe640 1 -- 172.21.15.77:0/927898027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56380ba5d0 con 0x7f5638153220 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f56377fe640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 0x7f56381ef3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56280098a0 tx=0x7f562801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f562f7fe640 1 -- 172.21.15.77:0/927898027 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280ba070 con 0x7f5638153220 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f562f7fe640 1 -- 172.21.15.77:0/927898027 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56280abc90 con 0x7f5638153220 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56380a9d40 con 0x7f5638153220 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f562f7fe640 1 -- 172.21.15.77:0/927898027 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5628004230 con 0x7f5638153220 2024-04-25T13:41:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56380be550 con 0x7f5638153220 2024-04-25T13:41:23.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.222+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56380be360 con 0x7f5638153220 2024-04-25T13:41:23.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.226+0000 7f562f7fe640 1 -- 172.21.15.77:0/927898027 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5628003620 con 0x7f5638153220 2024-04-25T13:41:23.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.226+0000 7f562f7fe640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f561806f430 0x7f5618071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:23.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.226+0000 7f562f7fe640 1 -- 172.21.15.77:0/927898027 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5628128c30 con 0x7f5638153220 2024-04-25T13:41:23.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.226+0000 7f5636ffd640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f561806f430 0x7f5618071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:23.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.226+0000 7f5636ffd640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f561806f430 0x7f5618071940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f56380c19d0 tx=0x7f56300094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:23.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.230+0000 7f562f7fe640 1 -- 172.21.15.77:0/927898027 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f56280a8050 con 0x7f5638153220 2024-04-25T13:41:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.422+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f563806a280 con 0x7f5638153220 2024-04-25T13:41:23.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.422+0000 7f562f7fe640 1 -- 172.21.15.77:0/927898027 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f56280160f0 con 0x7f5638153220 2024-04-25T13:41:23.425 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T13:41:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f561806f430 msgr2=0x7f5618071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f561806f430 0x7f5618071940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f56380c19d0 tx=0x7f56300094f0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 msgr2=0x7f56381ef3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 0x7f56381ef3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56280098a0 tx=0x7f562801ad40 comp rx=0 tx=0).stop 2024-04-25T13:41:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 shutdown_connections 2024-04-25T13:41:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f561806f430 0x7f5618071940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5638153220 0x7f56381ef3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56380c6970 0x7f56380a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 --2- 172.21.15.77:0/927898027 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56380a6960 0x7f56381eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 >> 172.21.15.77:0/927898027 conn(0x7f563806ded0 msgr2=0x7f56380bfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:23.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 shutdown_connections 2024-04-25T13:41:23.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:41:23.426+0000 7f563d492640 1 -- 172.21.15.77:0/927898027 wait complete. 2024-04-25T13:41:23.446 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:41:23.446 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:41:23.447 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2024-04-25T13:41:23.447 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T13:41:23.447 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T13:41:23.447 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:41:23.447 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:41:23.447 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:41:23.447 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T13:41:23.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:23.447 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f0 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:23.454 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f1 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42468sec preferred_lft 42468sec 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::ec4:7aff:fe88:7211/64 scope link 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 02:42:a0:7d:56:08 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T13:41:23.455 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:41:23.455 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:41:23.456 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:23.456 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-25T13:41:23.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:41:23.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr flush dev ceph-brx 2024-04-25T13:41:23.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set ceph-brx up 2024-04-25T13:41:23.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:41:23.456 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-25T13:41:23.542 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:23.573 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:23.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:23.580 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:41:23.589 INFO:teuthology.orchestra.run.smithi191.stdout:1 2024-04-25T13:41:23.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:23.591 DEBUG:teuthology.orchestra.run.smithi191:> route 2024-04-25T13:41:23.708 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:41:23.709 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:41:23.709 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:23.710 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-25T13:41:23.710 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:41:23.710 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:41:23.710 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:41:23.710 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-25T13:41:23.751 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:23.778 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:23.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:23.786 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:23.833 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2024-04-25T13:41:23.881 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:23.881 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-25T13:41:23.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:41:23.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 0 2024-04-25T13:41:23.881 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-25T13:41:23.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:23.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:23.997 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.1/16 2024-04-25T13:41:23.997 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:23.997 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-25T13:41:23.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.0 2024-04-25T13:41:23.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:41:23.998 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T13:41:23.998 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T13:41:23.998 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T13:41:23.998 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-25T13:41:24.042 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:24.098 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:24.105 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:41:24.105 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-25T13:41:24.105 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.0 up 2024-04-25T13:41:24.105 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:41:24.105 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-25T13:41:24.185 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:41:24.199 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:24.205 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-25T13:41:24.205 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:41:24.205 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T13:41:24.256 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T13:41:24.256 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:41:24.256 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T13:41:24.303 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe fuse 2024-04-25T13:41:24.361 DEBUG:teuthology.orchestra.run.smithi191:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:41:24.409 INFO:teuthology.orchestra.run.smithi191.stdout:/sys 2024-04-25T13:41:24.409 INFO:teuthology.orchestra.run.smithi191.stdout:/proc 2024-04-25T13:41:24.409 INFO:teuthology.orchestra.run.smithi191.stdout:/dev 2024-04-25T13:41:24.409 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/pts 2024-04-25T13:41:24.409 INFO:teuthology.orchestra.run.smithi191.stdout:/run 2024-04-25T13:41:24.409 INFO:teuthology.orchestra.run.smithi191.stdout:/ 2024-04-25T13:41:24.409 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/security 2024-04-25T13:41:24.409 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/shm 2024-04-25T13:41:24.409 INFO:teuthology.orchestra.run.smithi191.stdout:/run/lock 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/pstore 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/bpf 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/mqueue 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/hugepages 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/debug 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/tracing 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/proc/fs/nfsd 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/fuse/connections 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/config 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:41:24.410 INFO:teuthology.orchestra.run.smithi191.stdout:/run/rpc_pipefs 2024-04-25T13:41:24.411 INFO:teuthology.orchestra.run.smithi191.stdout:/run/user/1000 2024-04-25T13:41:24.411 INFO:teuthology.orchestra.run.smithi191.stdout:/var/lib/ceph 2024-04-25T13:41:24.411 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns 2024-04-25T13:41:24.411 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:41:24.411 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:41:24.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:24.412 DEBUG:teuthology.orchestra.run.smithi191:> ls /sys/fs/fuse/connections 2024-04-25T13:41:24.460 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:41:24.460 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-25T13:41:24.505 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe fuse 2024-04-25T13:41:24.520 DEBUG:teuthology.orchestra.run.smithi191:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:41:24.572 INFO:teuthology.orchestra.run.smithi191.stdout:/sys 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/proc 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/dev 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/pts 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/run 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/ 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/security 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/shm 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/run/lock 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/pstore 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/bpf 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/mqueue 2024-04-25T13:41:24.573 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/hugepages 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/debug 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/tracing 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/proc/fs/nfsd 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/fuse/connections 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/config 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/run/rpc_pipefs 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/run/user/1000 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/var/lib/ceph 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:41:24.574 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:41:24.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:24.575 DEBUG:teuthology.orchestra.run.smithi191:> ls /sys/fs/fuse/connections 2024-04-25T13:41:24.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi191.stderr:2024-04-25T13:41:24.622+0000 7f127fea9580 -1 init, newargv = 0x7f127400a290 newargc=15 2024-04-25T13:41:24.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi191.stderr:ceph-fuse[22810]: starting ceph client 2024-04-25T13:41:24.636 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi191.stderr:ceph-fuse[22810]: starting fuse 2024-04-25T13:41:25.728 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe fuse 2024-04-25T13:41:25.745 DEBUG:teuthology.orchestra.run.smithi191:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:41:25.793 INFO:teuthology.orchestra.run.smithi191.stdout:/sys 2024-04-25T13:41:25.793 INFO:teuthology.orchestra.run.smithi191.stdout:/proc 2024-04-25T13:41:25.793 INFO:teuthology.orchestra.run.smithi191.stdout:/dev 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/pts 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/run 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/ 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/security 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/shm 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/run/lock 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/cgroup 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/pstore 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/bpf 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/mqueue 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/hugepages 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/debug 2024-04-25T13:41:25.794 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/tracing 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/proc/fs/nfsd 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/fs/fuse/connections 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/sys/kernel/config 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/run/rpc_pipefs 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/run/user/1000 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/var/lib/ceph 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:41:25.795 INFO:teuthology.orchestra.run.smithi191.stdout:/home/ubuntu/cephtest/mnt.2 2024-04-25T13:41:25.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:25.796 DEBUG:teuthology.orchestra.run.smithi191:> ls /sys/fs/fuse/connections 2024-04-25T13:41:25.844 INFO:teuthology.orchestra.run.smithi191.stdout:45 2024-04-25T13:41:25.845 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T13:41:25.845 DEBUG:teuthology.orchestra.run.smithi191:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:41:25.845 DEBUG:teuthology.orchestra.run.smithi191:> import glob 2024-04-25T13:41:25.845 DEBUG:teuthology.orchestra.run.smithi191:> import re 2024-04-25T13:41:25.845 DEBUG:teuthology.orchestra.run.smithi191:> import os 2024-04-25T13:41:25.845 DEBUG:teuthology.orchestra.run.smithi191:> import subprocess 2024-04-25T13:41:25.845 DEBUG:teuthology.orchestra.run.smithi191:> 2024-04-25T13:41:25.845 DEBUG:teuthology.orchestra.run.smithi191:> def _find_admin_socket(client_name): 2024-04-25T13:41:25.845 DEBUG:teuthology.orchestra.run.smithi191:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> files = glob.glob(asok_path) 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> # Given a non-glob path, it better be there 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> if "*" not in asok_path: 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> assert(len(files) == 1) 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> return files[0] 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> for f in files: 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:41:25.846 DEBUG:teuthology.orchestra.run.smithi191:> contents = proc_f.read() 2024-04-25T13:41:25.847 DEBUG:teuthology.orchestra.run.smithi191:> if mountpoint in contents: 2024-04-25T13:41:25.847 DEBUG:teuthology.orchestra.run.smithi191:> return f 2024-04-25T13:41:25.847 DEBUG:teuthology.orchestra.run.smithi191:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:41:25.847 DEBUG:teuthology.orchestra.run.smithi191:> 2024-04-25T13:41:25.847 DEBUG:teuthology.orchestra.run.smithi191:> print(_find_admin_socket("client.2")) 2024-04-25T13:41:25.847 DEBUG:teuthology.orchestra.run.smithi191:> ' 2024-04-25T13:41:25.967 INFO:teuthology.orchestra.run.smithi191.stdout:/var/run/ceph/ceph-client.2.22810.asok 2024-04-25T13:41:25.971 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:41:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:41:25.979 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.22810.asok 2024-04-25T13:41:25.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:25.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.22810.asok status 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout: "metadata": { 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout: "entity_id": "2", 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout: "hostname": "smithi191", 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout: "pid": "22810", 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout: "root": "/" 2024-04-25T13:41:26.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "dentry_count": 0, 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "dentry_pinned_count": 0, 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "id": 4466, 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "inst": { 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "name": { 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "client", 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "num": 4466 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": { 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "v1", 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": "172.21.15.191:0", 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: "nonce": 844835182 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T13:41:26.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": { 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "v1", 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": "172.21.15.191:0", 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "nonce": 844835182 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "inst_str": "client.4466 172.21.15.191:0/844835182", 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "addr_str": "172.21.15.191:0/844835182", 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "inode_count": 1, 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_epoch": 7, 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_epoch": 21, 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "blocklisted": false, 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout: "fs_name": "cephfs" 2024-04-25T13:41:26.167 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T13:41:26.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:26.180 DEBUG:teuthology.orchestra.run.smithi097:> stat --file-system '--printf=%T 2024-04-25T13:41:26.181 DEBUG:teuthology.orchestra.run.smithi097:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T13:41:26.188 INFO:teuthology.orchestra.run.smithi097.stdout:fuseblk 2024-04-25T13:41:26.188 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T13:41:26.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:26.188 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:41:26.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:26.245 DEBUG:teuthology.orchestra.run.smithi151:> stat --file-system '--printf=%T 2024-04-25T13:41:26.245 DEBUG:teuthology.orchestra.run.smithi151:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-25T13:41:26.253 INFO:teuthology.orchestra.run.smithi151.stdout:fuseblk 2024-04-25T13:41:26.253 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-25T13:41:26.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:26.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T13:41:26.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:26.316 DEBUG:teuthology.orchestra.run.smithi191:> stat --file-system '--printf=%T 2024-04-25T13:41:26.316 DEBUG:teuthology.orchestra.run.smithi191:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-25T13:41:26.323 INFO:teuthology.orchestra.run.smithi191.stdout:fuseblk 2024-04-25T13:41:26.323 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-25T13:41:26.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:41:26.323 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T13:41:26.376 INFO:teuthology.run_tasks:Running task pexec... 2024-04-25T13:41:26.394 INFO:teuthology.task.pexec:Executing custom commands... 2024-04-25T13:41:26.395 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi097.front.sepia.ceph.com 2024-04-25T13:41:26.395 DEBUG:teuthology.orchestra.run.smithi097:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-25T13:41:26.395 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T13:41:26.395 DEBUG:teuthology.orchestra.run.smithi151:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-25T13:41:26.396 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:41:26.396 DEBUG:teuthology.orchestra.run.smithi191:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-25T13:41:26.403 INFO:teuthology.orchestra.run.smithi151.stderr:+ cd /home/ubuntu/cephtest 2024-04-25T13:41:26.403 INFO:teuthology.orchestra.run.smithi151.stderr:+ sudo apt purge -y mpich 2024-04-25T13:41:26.403 INFO:teuthology.orchestra.run.smithi097.stderr:+ cd /home/ubuntu/cephtest 2024-04-25T13:41:26.404 INFO:teuthology.orchestra.run.smithi097.stderr:+ sudo apt purge -y mpich 2024-04-25T13:41:26.412 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:41:26.412 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-25T13:41:26.412 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:41:26.416 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:41:26.416 INFO:teuthology.orchestra.run.smithi097.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-25T13:41:26.416 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:41:26.424 INFO:teuthology.orchestra.run.smithi191.stderr:+ cd /home/ubuntu/cephtest 2024-04-25T13:41:26.424 INFO:teuthology.orchestra.run.smithi191.stderr:+ sudo apt purge -y mpich 2024-04-25T13:41:26.435 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:41:26.435 INFO:teuthology.orchestra.run.smithi191.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-25T13:41:26.435 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:41:26.463 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:41:26.469 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:41:26.486 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:41:26.668 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-04-25T13:41:26.669 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-04-25T13:41:26.673 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-25T13:41:26.674 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-25T13:41:26.677 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-25T13:41:26.678 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-25T13:41:26.844 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:41:26.844 INFO:teuthology.orchestra.run.smithi191.stdout: hwloc-nox libboost-iostreams1.74.0 libboost-thread1.74.0 libfabric1 2024-04-25T13:41:26.844 INFO:teuthology.orchestra.run.smithi191.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libhwloc-plugins libhwloc15 2024-04-25T13:41:26.844 INFO:teuthology.orchestra.run.smithi191.stdout: libiscsi7 libmpich12 libpmemobj1 libpsm-infinipath1 libpsm2-2 libpython2-dev 2024-04-25T13:41:26.844 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2-stdlib libpython2.7 libpython2.7-dev libpython2.7-minimal 2024-04-25T13:41:26.844 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7-stdlib libslurm37 libxnvctrl0 linux-image-5.4.0-135-generic 2024-04-25T13:41:26.845 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2024-04-25T13:41:26.845 INFO:teuthology.orchestra.run.smithi191.stdout: python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:41:26.845 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:41:26.865 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:41:26.865 INFO:teuthology.orchestra.run.smithi151.stdout: hwloc-nox libboost-iostreams1.74.0 libboost-thread1.74.0 libfabric1 2024-04-25T13:41:26.865 INFO:teuthology.orchestra.run.smithi151.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libhwloc-plugins libhwloc15 2024-04-25T13:41:26.865 INFO:teuthology.orchestra.run.smithi151.stdout: libiscsi7 libmpich12 libpmemobj1 libpsm-infinipath1 libpsm2-2 libpython2-dev 2024-04-25T13:41:26.865 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2-stdlib libpython2.7 libpython2.7-dev libpython2.7-minimal 2024-04-25T13:41:26.867 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7-stdlib libslurm37 libxnvctrl0 linux-image-5.4.0-135-generic 2024-04-25T13:41:26.867 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2024-04-25T13:41:26.867 INFO:teuthology.orchestra.run.smithi151.stdout: python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:41:26.867 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:41:26.867 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:41:26.867 INFO:teuthology.orchestra.run.smithi097.stdout: hwloc-nox libboost-iostreams1.74.0 libboost-thread1.74.0 libfabric1 2024-04-25T13:41:26.867 INFO:teuthology.orchestra.run.smithi097.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libhwloc-plugins libhwloc15 2024-04-25T13:41:26.868 INFO:teuthology.orchestra.run.smithi097.stdout: libiscsi7 libmpich12 libpmemobj1 libpsm-infinipath1 libpsm2-2 libpython2-dev 2024-04-25T13:41:26.868 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2-stdlib libpython2.7 libpython2.7-dev libpython2.7-minimal 2024-04-25T13:41:26.868 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7-stdlib libslurm37 libxnvctrl0 linux-image-5.4.0-135-generic 2024-04-25T13:41:26.868 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2024-04-25T13:41:26.868 INFO:teuthology.orchestra.run.smithi097.stdout: python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:41:26.868 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:41:26.869 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages will be REMOVED: 2024-04-25T13:41:26.870 INFO:teuthology.orchestra.run.smithi191.stdout: libmpich-dev* mpich* 2024-04-25T13:41:26.892 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be REMOVED: 2024-04-25T13:41:26.893 INFO:teuthology.orchestra.run.smithi151.stdout: libmpich-dev* mpich* 2024-04-25T13:41:26.893 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be REMOVED: 2024-04-25T13:41:26.894 INFO:teuthology.orchestra.run.smithi097.stdout: libmpich-dev* mpich* 2024-04-25T13:41:27.199 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 0 newly installed, 2 to remove and 298 not upgraded. 2024-04-25T13:41:27.199 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 60.3 MB disk space will be freed. 2024-04-25T13:41:27.211 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 0 newly installed, 2 to remove and 298 not upgraded. 2024-04-25T13:41:27.212 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 60.3 MB disk space will be freed. 2024-04-25T13:41:27.262 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 0 newly installed, 2 to remove and 298 not upgraded. 2024-04-25T13:41:27.262 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 60.3 MB disk space will be freed. 2024-04-25T13:41:27.324 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176797 files and directories currently installed.) 2024-04-25T13:41:27.330 INFO:teuthology.orchestra.run.smithi191.stdout:Removing libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:27.333 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176797 files and directories currently installed.) 2024-04-25T13:41:27.339 INFO:teuthology.orchestra.run.smithi151.stdout:Removing libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:27.384 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176797 files and directories currently installed.) 2024-04-25T13:41:27.389 INFO:teuthology.orchestra.run.smithi097.stdout:Removing libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:27.644 INFO:teuthology.orchestra.run.smithi191.stdout:Removing mpich (4.0-3) ... 2024-04-25T13:41:27.664 INFO:teuthology.orchestra.run.smithi151.stdout:Removing mpich (4.0-3) ... 2024-04-25T13:41:27.698 INFO:teuthology.orchestra.run.smithi097.stdout:Removing mpich (4.0-3) ... 2024-04-25T13:41:28.133 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:28.138 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:28.174 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:29.422 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176723 files and directories currently installed.) 2024-04-25T13:41:29.425 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176723 files and directories currently installed.) 2024-04-25T13:41:29.427 INFO:teuthology.orchestra.run.smithi191.stdout:Purging configuration files for libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:29.430 INFO:teuthology.orchestra.run.smithi097.stdout:Purging configuration files for libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:29.492 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176723 files and directories currently installed.) 2024-04-25T13:41:29.498 INFO:teuthology.orchestra.run.smithi151.stdout:Purging configuration files for libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:dpkg: warning: while removing libmpich-dev:amd64, directory '/usr/lib/x86_64-linux-gnu/fortran' not empty so not removed 2024-04-25T13:41:29.621 INFO:teuthology.orchestra.run.smithi191.stdout:dpkg: warning: while removing libmpich-dev:amd64, directory '/usr/lib/x86_64-linux-gnu/fortran' not empty so not removed 2024-04-25T13:41:29.753 INFO:teuthology.orchestra.run.smithi151.stdout:dpkg: warning: while removing libmpich-dev:amd64, directory '/usr/lib/x86_64-linux-gnu/fortran' not empty so not removed 2024-04-25T13:41:30.148 INFO:teuthology.orchestra.run.smithi097.stderr:+ sudo apt install -y mpich 2024-04-25T13:41:30.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:41:30.157 INFO:teuthology.orchestra.run.smithi097.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-25T13:41:30.157 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:41:30.192 INFO:teuthology.orchestra.run.smithi191.stderr:+ sudo apt install -y mpich 2024-04-25T13:41:30.201 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:41:30.201 INFO:teuthology.orchestra.run.smithi191.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-25T13:41:30.201 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:41:30.203 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:41:30.248 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:41:30.321 INFO:teuthology.orchestra.run.smithi151.stderr:+ sudo apt install -y mpich 2024-04-25T13:41:30.331 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:41:30.331 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-25T13:41:30.331 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:41:30.371 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:41:30.404 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-25T13:41:30.405 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-25T13:41:30.448 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-25T13:41:30.449 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-25T13:41:30.553 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-04-25T13:41:30.554 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-04-25T13:41:30.587 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:41:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:41:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:41:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:41:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:41:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:41:30.587 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:41:30.588 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-04-25T13:41:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: libmpich-dev 2024-04-25T13:41:30.590 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-25T13:41:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: mpich-doc 2024-04-25T13:41:30.615 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-25T13:41:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: libmpich-dev mpich 2024-04-25T13:41:30.639 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:41:30.639 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:41:30.639 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:41:30.639 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:41:30.639 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:41:30.639 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:41:30.639 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:41:30.640 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2024-04-25T13:41:30.641 INFO:teuthology.orchestra.run.smithi191.stdout: libmpich-dev 2024-04-25T13:41:30.642 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2024-04-25T13:41:30.642 INFO:teuthology.orchestra.run.smithi191.stdout: mpich-doc 2024-04-25T13:41:30.669 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2024-04-25T13:41:30.669 INFO:teuthology.orchestra.run.smithi191.stdout: libmpich-dev mpich 2024-04-25T13:41:30.674 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 2 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:41:30.674 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 7,571 kB of archives. 2024-04-25T13:41:30.674 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 60.3 MB of additional disk space will be used. 2024-04-25T13:41:30.674 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 mpich amd64 4.0-3 [197 kB] 2024-04-25T13:41:30.717 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:41:30.717 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:41:30.717 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:41:30.717 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:41:30.718 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:41:30.718 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:41:30.718 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:41:30.718 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-04-25T13:41:30.719 INFO:teuthology.orchestra.run.smithi151.stdout: libmpich-dev 2024-04-25T13:41:30.720 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-04-25T13:41:30.720 INFO:teuthology.orchestra.run.smithi151.stdout: mpich-doc 2024-04-25T13:41:30.728 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 2 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:41:30.728 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 7,571 kB of archives. 2024-04-25T13:41:30.728 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 60.3 MB of additional disk space will be used. 2024-04-25T13:41:30.728 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 mpich amd64 4.0-3 [197 kB] 2024-04-25T13:41:30.746 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-04-25T13:41:30.747 INFO:teuthology.orchestra.run.smithi151.stdout: libmpich-dev mpich 2024-04-25T13:41:30.776 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmpich-dev amd64 4.0-3 [7,375 kB] 2024-04-25T13:41:30.803 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 2 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:41:30.803 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 7,571 kB of archives. 2024-04-25T13:41:30.803 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 60.3 MB of additional disk space will be used. 2024-04-25T13:41:30.803 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 mpich amd64 4.0-3 [197 kB] 2024-04-25T13:41:30.920 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmpich-dev amd64 4.0-3 [7,375 kB] 2024-04-25T13:41:31.214 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: unable to initialize frontend: Dialog 2024-04-25T13:41:31.214 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-25T13:41:31.214 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: falling back to frontend: Readline 2024-04-25T13:41:31.216 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmpich-dev amd64 4.0-3 [7,375 kB] 2024-04-25T13:41:31.224 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: unable to initialize frontend: Readline 2024-04-25T13:41:31.224 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-25T13:41:31.224 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: falling back to frontend: Teletype 2024-04-25T13:41:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-25T13:41:31.262 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 7,571 kB in 0s (24.9 MB/s) 2024-04-25T13:41:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: unable to initialize frontend: Dialog 2024-04-25T13:41:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-25T13:41:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: falling back to frontend: Readline 2024-04-25T13:41:31.393 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package mpich. 2024-04-25T13:41:31.399 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: unable to initialize frontend: Readline 2024-04-25T13:41:31.399 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-25T13:41:31.399 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: falling back to frontend: Teletype 2024-04-25T13:41:31.403 INFO:teuthology.orchestra.run.smithi151.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-25T13:41:31.434 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 7,571 kB in 0s (21.9 MB/s) 2024-04-25T13:41:31.497 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176722 files and directories currently installed.) 2024-04-25T13:41:31.503 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../archives/mpich_4.0-3_amd64.deb ... 2024-04-25T13:41:31.550 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking mpich (4.0-3) ... 2024-04-25T13:41:31.609 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package mpich. 2024-04-25T13:41:31.702 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: unable to initialize frontend: Dialog 2024-04-25T13:41:31.702 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-25T13:41:31.702 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: falling back to frontend: Readline 2024-04-25T13:41:31.707 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176722 files and directories currently installed.) 2024-04-25T13:41:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../archives/mpich_4.0-3_amd64.deb ... 2024-04-25T13:41:31.714 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: unable to initialize frontend: Readline 2024-04-25T13:41:31.714 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-25T13:41:31.714 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: falling back to frontend: Teletype 2024-04-25T13:41:31.717 INFO:teuthology.orchestra.run.smithi191.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-25T13:41:31.750 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 7,571 kB in 1s (10.4 MB/s) 2024-04-25T13:41:31.757 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking mpich (4.0-3) ... 2024-04-25T13:41:31.886 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package mpich. 2024-04-25T13:41:31.971 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmpich-dev:amd64. 2024-04-25T13:41:31.979 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176722 files and directories currently installed.) 2024-04-25T13:41:31.985 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../archives/mpich_4.0-3_amd64.deb ... 2024-04-25T13:41:32.000 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libmpich-dev_4.0-3_amd64.deb ... 2024-04-25T13:41:32.035 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking mpich (4.0-3) ... 2024-04-25T13:41:32.048 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:32.212 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmpich-dev:amd64. 2024-04-25T13:41:32.240 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../libmpich-dev_4.0-3_amd64.deb ... 2024-04-25T13:41:32.314 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:32.509 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libmpich-dev:amd64. 2024-04-25T13:41:32.537 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../libmpich-dev_4.0-3_amd64.deb ... 2024-04-25T13:41:32.587 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:32.899 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up mpich (4.0-3) ... 2024-04-25T13:41:32.991 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/mpicc.mpich to provide /usr/bin/mpicc (mpi) in auto mode 2024-04-25T13:41:33.022 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/mpirun.mpich to provide /usr/bin/mpirun (mpirun) in auto mode 2024-04-25T13:41:33.077 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:33.160 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/include/x86_64-linux-gnu/mpich to provide /usr/include/x86_64-linux-gnu/mpi (mpi-x86_64-linux-gnu) in auto mode 2024-04-25T13:41:33.231 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:33.374 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up mpich (4.0-3) ... 2024-04-25T13:41:33.465 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/mpicc.mpich to provide /usr/bin/mpicc (mpi) in auto mode 2024-04-25T13:41:33.505 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/mpirun.mpich to provide /usr/bin/mpirun (mpirun) in auto mode 2024-04-25T13:41:33.577 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:33.579 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up mpich (4.0-3) ... 2024-04-25T13:41:33.672 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/mpicc.mpich to provide /usr/bin/mpicc (mpi) in auto mode 2024-04-25T13:41:33.684 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/include/x86_64-linux-gnu/mpich to provide /usr/include/x86_64-linux-gnu/mpi (mpi-x86_64-linux-gnu) in auto mode 2024-04-25T13:41:33.730 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/mpirun.mpich to provide /usr/bin/mpirun (mpirun) in auto mode 2024-04-25T13:41:33.755 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:33.809 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libmpich-dev:amd64 (4.0-3) ... 2024-04-25T13:41:33.915 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/include/x86_64-linux-gnu/mpich to provide /usr/include/x86_64-linux-gnu/mpi (mpi-x86_64-linux-gnu) in auto mode 2024-04-25T13:41:33.988 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:34.534 INFO:teuthology.orchestra.run.smithi097.stderr:+ wget http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-25T13:41:34.559 INFO:teuthology.orchestra.run.smithi097.stderr:--2024-04-25 13:41:34-- http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-25T13:41:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-25T13:41:34.581 INFO:teuthology.orchestra.run.smithi097.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-25T13:41:34.602 INFO:teuthology.orchestra.run.smithi097.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-25T13:41:34.603 INFO:teuthology.orchestra.run.smithi097.stderr:Length: 250606 (245K) [application/octet-stream] 2024-04-25T13:41:34.603 INFO:teuthology.orchestra.run.smithi097.stderr:Saving to: 'ior-3.3.0.tar.bz2' 2024-04-25T13:41:34.603 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:41:34.644 INFO:teuthology.orchestra.run.smithi097.stderr: 0K .......... .......... .......... .......... .......... 20% 1.18M 0s 2024-04-25T13:41:34.665 INFO:teuthology.orchestra.run.smithi097.stderr: 50K .......... .......... .......... .......... .......... 40% 2.38M 0s 2024-04-25T13:41:34.665 INFO:teuthology.orchestra.run.smithi097.stderr: 100K .......... .......... .......... .......... .......... 61% 125M 0s 2024-04-25T13:41:34.685 INFO:teuthology.orchestra.run.smithi097.stderr: 150K .......... .......... .......... .......... .......... 81% 2.42M 0s 2024-04-25T13:41:34.705 INFO:teuthology.orchestra.run.smithi097.stderr: 200K .......... .......... .......... .......... .... 100% 2.12M=0.1s 2024-04-25T13:41:34.705 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:41:34.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-25 13:41:34 (2.32 MB/s) - 'ior-3.3.0.tar.bz2' saved [250606/250606] 2024-04-25T13:41:34.705 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:41:34.706 INFO:teuthology.orchestra.run.smithi097.stderr:+ tar xvfj ior-3.3.0.tar.bz2 2024-04-25T13:41:34.744 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/ 2024-04-25T13:41:34.744 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/AUTHORS 2024-04-25T13:41:34.744 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/COPYRIGHT 2024-04-25T13:41:34.744 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/META 2024-04-25T13:41:34.744 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/Makefile.am 2024-04-25T13:41:34.744 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/Makefile.in 2024-04-25T13:41:34.744 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/NEWS 2024-04-25T13:41:34.745 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/README.md 2024-04-25T13:41:34.745 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/aclocal.m4 2024-04-25T13:41:34.745 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/ 2024-04-25T13:41:34.745 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/ax_prog_cc_mpi.m4 2024-04-25T13:41:34.745 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/compile 2024-04-25T13:41:34.745 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/config.guess 2024-04-25T13:41:34.746 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/config.sub 2024-04-25T13:41:34.746 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/depcomp 2024-04-25T13:41:34.747 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/install-sh 2024-04-25T13:41:34.747 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/missing 2024-04-25T13:41:34.747 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/test-driver 2024-04-25T13:41:34.748 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/config/x_ac_meta.m4 2024-04-25T13:41:34.748 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/configure 2024-04-25T13:41:34.752 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/configure.ac 2024-04-25T13:41:34.752 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/contrib/ 2024-04-25T13:41:34.752 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/contrib/Makefile.am 2024-04-25T13:41:34.752 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/contrib/Makefile.in 2024-04-25T13:41:34.752 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/contrib/cbif.c 2024-04-25T13:41:34.752 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/doc/ 2024-04-25T13:41:34.752 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/doc/Makefile.am 2024-04-25T13:41:34.752 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/doc/Makefile.in 2024-04-25T13:41:34.753 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/doc/USER_GUIDE 2024-04-25T13:41:34.753 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/doc/mdtest.1 2024-04-25T13:41:34.753 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/ 2024-04-25T13:41:34.753 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/Makefile.am 2024-04-25T13:41:34.753 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/Makefile.in 2024-04-25T13:41:34.756 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-CEPHFS.c 2024-04-25T13:41:34.756 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-DAOS.c 2024-04-25T13:41:34.756 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-DFS.c 2024-04-25T13:41:34.756 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-DUMMY.c 2024-04-25T13:41:34.756 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-Gfarm.c 2024-04-25T13:41:34.757 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-HDF5.c 2024-04-25T13:41:34.757 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-HDFS.c 2024-04-25T13:41:34.757 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-IME.c 2024-04-25T13:41:34.757 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-MMAP.c 2024-04-25T13:41:34.757 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-MPIIO.c 2024-04-25T13:41:34.766 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-NCMPI.c 2024-04-25T13:41:34.766 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-POSIX.c 2024-04-25T13:41:34.766 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-RADOS.c 2024-04-25T13:41:34.766 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori-S3.c 2024-04-25T13:41:34.767 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori.c 2024-04-25T13:41:34.767 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/aiori.h 2024-04-25T13:41:34.767 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/config.h.in 2024-04-25T13:41:34.767 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/ior-internal.h 2024-04-25T13:41:34.767 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/ior-main.c 2024-04-25T13:41:34.767 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/ior-output.c 2024-04-25T13:41:34.768 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/ior.c 2024-04-25T13:41:34.768 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/ior.h 2024-04-25T13:41:34.769 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/iordef.h 2024-04-25T13:41:34.769 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/mdtest-main.c 2024-04-25T13:41:34.769 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/mdtest.c 2024-04-25T13:41:34.770 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/mdtest.h 2024-04-25T13:41:34.770 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/option.c 2024-04-25T13:41:34.770 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/option.h 2024-04-25T13:41:34.771 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/parse_options.c 2024-04-25T13:41:34.771 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/parse_options.h 2024-04-25T13:41:34.771 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/test/ 2024-04-25T13:41:34.771 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/test/Makefile.am 2024-04-25T13:41:34.771 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/test/Makefile.in 2024-04-25T13:41:34.771 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/test/example.c 2024-04-25T13:41:34.771 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/test/lib.c 2024-04-25T13:41:34.771 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/utilities.c 2024-04-25T13:41:34.774 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/src/utilities.h 2024-04-25T13:41:34.774 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/ 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/basic-tests.sh 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/bug-multi-node.conf 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/build/ 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/build/test/ 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/complex-tests.sh 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/ 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/README.md 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/centos6/ 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/centos6/Dockerfile 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/centos6/run-test.sh 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/centos7/ 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/centos7/Dockerfile 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/centos7/run-test.sh 2024-04-25T13:41:34.775 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/ceph/ 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/ceph/NOTES 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/prepare.sh 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/run-all-tests.sh 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/ubuntu14.04/ 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/ubuntu14.04/Dockerfile 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/ubuntu14.04/run-test.sh 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/ubuntu16.04/ 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/ubuntu16.04/Dockerfile 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/docker/ubuntu16.04/run-test.sh 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/ 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/ 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/3.txt 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/4.txt 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/5.txt 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/basic/ 2024-04-25T13:41:34.776 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/basic/0.txt 2024-04-25T13:41:34.777 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/basic/1.txt 2024-04-25T13:41:34.777 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/basic/2.txt 2024-04-25T13:41:34.777 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/mdtest-patterns/basic/3.txt 2024-04-25T13:41:34.777 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/test-lib.sh 2024-04-25T13:41:34.777 INFO:teuthology.orchestra.run.smithi097.stdout:ior-3.3.0/testing/test_comments.ior 2024-04-25T13:41:34.777 INFO:teuthology.orchestra.run.smithi097.stderr:+ cd ior-3.3.0 2024-04-25T13:41:34.777 INFO:teuthology.orchestra.run.smithi097.stderr:+ ./configure 2024-04-25T13:41:34.925 INFO:teuthology.orchestra.run.smithi097.stdout:checking metadata... yes 2024-04-25T13:41:35.144 INFO:teuthology.orchestra.run.smithi151.stderr:+ wget http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-25T13:41:35.167 INFO:teuthology.orchestra.run.smithi151.stderr:--2024-04-25 13:41:35-- http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-25T13:41:35.168 INFO:teuthology.orchestra.run.smithi151.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-25T13:41:35.205 INFO:teuthology.orchestra.run.smithi151.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-25T13:41:35.241 INFO:teuthology.orchestra.run.smithi151.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-25T13:41:35.241 INFO:teuthology.orchestra.run.smithi151.stderr:Length: 250606 (245K) [application/octet-stream] 2024-04-25T13:41:35.241 INFO:teuthology.orchestra.run.smithi151.stderr:Saving to: 'ior-3.3.0.tar.bz2' 2024-04-25T13:41:35.241 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:41:35.312 INFO:teuthology.orchestra.run.smithi151.stderr: 0K .......... .......... .......... .......... .......... 20% 702K 0s 2024-04-25T13:41:35.327 INFO:teuthology.orchestra.run.smithi097.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-25T13:41:35.327 INFO:teuthology.orchestra.run.smithi097.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-25T13:41:35.334 INFO:teuthology.orchestra.run.smithi097.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-25T13:41:35.337 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether build environment is sane... yes 2024-04-25T13:41:35.345 INFO:teuthology.orchestra.run.smithi097.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-25T13:41:35.345 INFO:teuthology.orchestra.run.smithi097.stdout:checking for gawk... gawk 2024-04-25T13:41:35.349 INFO:teuthology.orchestra.run.smithi151.stderr: 50K .......... .......... .......... .......... .......... 40% 1.37M 0s 2024-04-25T13:41:35.349 INFO:teuthology.orchestra.run.smithi151.stderr: 100K .......... .......... .......... .......... .......... 61% 93.9M 0s 2024-04-25T13:41:35.349 INFO:teuthology.orchestra.run.smithi151.stderr: 150K .......... .......... .......... .......... .......... 81% 178M 0s 2024-04-25T13:41:35.351 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether make sets $(MAKE)... yes 2024-04-25T13:41:35.356 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether make supports nested variables... yes 2024-04-25T13:41:35.360 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether make supports nested variables... (cached) yes 2024-04-25T13:41:35.360 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether to enable maintainer-specific portions of Makefiles... no 2024-04-25T13:41:35.362 INFO:teuthology.orchestra.run.smithi191.stderr:+ wget http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-25T13:41:35.367 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether make supports the include directive... yes (GNU style) 2024-04-25T13:41:35.368 INFO:teuthology.orchestra.run.smithi097.stdout:checking for mpicc... mpicc 2024-04-25T13:41:35.368 INFO:teuthology.orchestra.run.smithi097.stdout:checking for gcc... (cached) mpicc 2024-04-25T13:41:35.384 INFO:teuthology.orchestra.run.smithi151.stderr: 200K .......... .......... .......... .......... .... 100% 1.23M=0.1s 2024-04-25T13:41:35.384 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:41:35.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25 13:41:35 (1.67 MB/s) - 'ior-3.3.0.tar.bz2' saved [250606/250606] 2024-04-25T13:41:35.385 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:41:35.385 INFO:teuthology.orchestra.run.smithi151.stderr:+ tar xvfj ior-3.3.0.tar.bz2 2024-04-25T13:41:35.388 INFO:teuthology.orchestra.run.smithi191.stderr:--2024-04-25 13:41:35-- http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-25T13:41:35.389 INFO:teuthology.orchestra.run.smithi191.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-25T13:41:35.416 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/ 2024-04-25T13:41:35.416 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/AUTHORS 2024-04-25T13:41:35.416 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/COPYRIGHT 2024-04-25T13:41:35.416 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/META 2024-04-25T13:41:35.416 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/Makefile.am 2024-04-25T13:41:35.416 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/Makefile.in 2024-04-25T13:41:35.416 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/NEWS 2024-04-25T13:41:35.416 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/README.md 2024-04-25T13:41:35.416 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/aclocal.m4 2024-04-25T13:41:35.417 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/ 2024-04-25T13:41:35.417 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/ax_prog_cc_mpi.m4 2024-04-25T13:41:35.417 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/compile 2024-04-25T13:41:35.417 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/config.guess 2024-04-25T13:41:35.418 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/config.sub 2024-04-25T13:41:35.418 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/depcomp 2024-04-25T13:41:35.419 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/install-sh 2024-04-25T13:41:35.419 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/missing 2024-04-25T13:41:35.419 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/test-driver 2024-04-25T13:41:35.419 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/config/x_ac_meta.m4 2024-04-25T13:41:35.419 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/configure 2024-04-25T13:41:35.424 INFO:teuthology.orchestra.run.smithi191.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-25T13:41:35.425 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/configure.ac 2024-04-25T13:41:35.425 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/contrib/ 2024-04-25T13:41:35.425 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/contrib/Makefile.am 2024-04-25T13:41:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/contrib/Makefile.in 2024-04-25T13:41:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/contrib/cbif.c 2024-04-25T13:41:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/doc/ 2024-04-25T13:41:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/doc/Makefile.am 2024-04-25T13:41:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/doc/Makefile.in 2024-04-25T13:41:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/doc/USER_GUIDE 2024-04-25T13:41:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/doc/mdtest.1 2024-04-25T13:41:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/ 2024-04-25T13:41:35.426 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/Makefile.am 2024-04-25T13:41:35.427 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/Makefile.in 2024-04-25T13:41:35.427 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-CEPHFS.c 2024-04-25T13:41:35.427 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-DAOS.c 2024-04-25T13:41:35.427 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-DFS.c 2024-04-25T13:41:35.428 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-DUMMY.c 2024-04-25T13:41:35.428 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-Gfarm.c 2024-04-25T13:41:35.428 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-HDF5.c 2024-04-25T13:41:35.428 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-HDFS.c 2024-04-25T13:41:35.428 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-IME.c 2024-04-25T13:41:35.429 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-MMAP.c 2024-04-25T13:41:35.429 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-MPIIO.c 2024-04-25T13:41:35.437 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-NCMPI.c 2024-04-25T13:41:35.437 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-POSIX.c 2024-04-25T13:41:35.437 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-RADOS.c 2024-04-25T13:41:35.437 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori-S3.c 2024-04-25T13:41:35.438 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori.c 2024-04-25T13:41:35.438 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/aiori.h 2024-04-25T13:41:35.439 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/config.h.in 2024-04-25T13:41:35.439 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/ior-internal.h 2024-04-25T13:41:35.439 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/ior-main.c 2024-04-25T13:41:35.439 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/ior-output.c 2024-04-25T13:41:35.439 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/ior.c 2024-04-25T13:41:35.440 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/ior.h 2024-04-25T13:41:35.440 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/iordef.h 2024-04-25T13:41:35.440 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/mdtest-main.c 2024-04-25T13:41:35.440 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/mdtest.c 2024-04-25T13:41:35.441 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/mdtest.h 2024-04-25T13:41:35.441 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/option.c 2024-04-25T13:41:35.441 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/option.h 2024-04-25T13:41:35.441 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/parse_options.c 2024-04-25T13:41:35.445 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/parse_options.h 2024-04-25T13:41:35.445 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/test/ 2024-04-25T13:41:35.445 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/test/Makefile.am 2024-04-25T13:41:35.445 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/test/Makefile.in 2024-04-25T13:41:35.445 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/test/example.c 2024-04-25T13:41:35.445 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/test/lib.c 2024-04-25T13:41:35.445 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/utilities.c 2024-04-25T13:41:35.445 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/src/utilities.h 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/ 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/basic-tests.sh 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/bug-multi-node.conf 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/build/ 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/build/test/ 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/complex-tests.sh 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/ 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/README.md 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/centos6/ 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/centos6/Dockerfile 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/centos6/run-test.sh 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/centos7/ 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/centos7/Dockerfile 2024-04-25T13:41:35.446 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/centos7/run-test.sh 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/ceph/ 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/ceph/NOTES 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/prepare.sh 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/run-all-tests.sh 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/ubuntu14.04/ 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/ubuntu14.04/Dockerfile 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/ubuntu14.04/run-test.sh 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/ubuntu16.04/ 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/ubuntu16.04/Dockerfile 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/docker/ubuntu16.04/run-test.sh 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/ 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/ 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/3.txt 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/4.txt 2024-04-25T13:41:35.447 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/5.txt 2024-04-25T13:41:35.448 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/basic/ 2024-04-25T13:41:35.448 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/basic/0.txt 2024-04-25T13:41:35.448 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/basic/1.txt 2024-04-25T13:41:35.448 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/basic/2.txt 2024-04-25T13:41:35.448 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/mdtest-patterns/basic/3.txt 2024-04-25T13:41:35.448 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/test-lib.sh 2024-04-25T13:41:35.448 INFO:teuthology.orchestra.run.smithi151.stdout:ior-3.3.0/testing/test_comments.ior 2024-04-25T13:41:35.448 INFO:teuthology.orchestra.run.smithi151.stderr:+ cd ior-3.3.0 2024-04-25T13:41:35.449 INFO:teuthology.orchestra.run.smithi151.stderr:+ ./configure 2024-04-25T13:41:35.449 INFO:teuthology.orchestra.run.smithi191.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-25T13:41:35.450 INFO:teuthology.orchestra.run.smithi191.stderr:Length: 250606 (245K) [application/octet-stream] 2024-04-25T13:41:35.450 INFO:teuthology.orchestra.run.smithi191.stderr:Saving to: 'ior-3.3.0.tar.bz2' 2024-04-25T13:41:35.450 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:41:35.485 INFO:teuthology.orchestra.run.smithi191.stderr: 0K .......... .......... .......... .......... .......... 20% 1.19M 0s 2024-04-25T13:41:35.507 INFO:teuthology.orchestra.run.smithi191.stderr: 50K .......... .......... .......... .......... .......... 40% 2.36M 0s 2024-04-25T13:41:35.507 INFO:teuthology.orchestra.run.smithi191.stderr: 100K .......... .......... .......... .......... .......... 61% 98.6M 0s 2024-04-25T13:41:35.507 INFO:teuthology.orchestra.run.smithi191.stderr: 150K .......... .......... .......... .......... .......... 81% 156M 0s 2024-04-25T13:41:35.526 INFO:teuthology.orchestra.run.smithi191.stderr: 200K .......... .......... .......... .......... .... 100% 2.19M=0.08s 2024-04-25T13:41:35.526 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:41:35.526 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25 13:41:35 (2.90 MB/s) - 'ior-3.3.0.tar.bz2' saved [250606/250606] 2024-04-25T13:41:35.527 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:41:35.527 INFO:teuthology.orchestra.run.smithi191.stderr:+ tar xvfj ior-3.3.0.tar.bz2 2024-04-25T13:41:35.565 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/ 2024-04-25T13:41:35.565 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/AUTHORS 2024-04-25T13:41:35.565 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/COPYRIGHT 2024-04-25T13:41:35.565 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/META 2024-04-25T13:41:35.565 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/Makefile.am 2024-04-25T13:41:35.565 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/Makefile.in 2024-04-25T13:41:35.565 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/NEWS 2024-04-25T13:41:35.565 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/README.md 2024-04-25T13:41:35.566 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/aclocal.m4 2024-04-25T13:41:35.566 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/ 2024-04-25T13:41:35.566 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/ax_prog_cc_mpi.m4 2024-04-25T13:41:35.566 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/compile 2024-04-25T13:41:35.566 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/config.guess 2024-04-25T13:41:35.567 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/config.sub 2024-04-25T13:41:35.567 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/depcomp 2024-04-25T13:41:35.568 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/install-sh 2024-04-25T13:41:35.568 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/missing 2024-04-25T13:41:35.568 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/test-driver 2024-04-25T13:41:35.568 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/config/x_ac_meta.m4 2024-04-25T13:41:35.568 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/configure 2024-04-25T13:41:35.572 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/configure.ac 2024-04-25T13:41:35.572 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/contrib/ 2024-04-25T13:41:35.573 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/contrib/Makefile.am 2024-04-25T13:41:35.573 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/contrib/Makefile.in 2024-04-25T13:41:35.573 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/contrib/cbif.c 2024-04-25T13:41:35.573 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/doc/ 2024-04-25T13:41:35.573 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/doc/Makefile.am 2024-04-25T13:41:35.573 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/doc/Makefile.in 2024-04-25T13:41:35.573 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/doc/USER_GUIDE 2024-04-25T13:41:35.574 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/doc/mdtest.1 2024-04-25T13:41:35.574 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/ 2024-04-25T13:41:35.574 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/Makefile.am 2024-04-25T13:41:35.574 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/Makefile.in 2024-04-25T13:41:35.576 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-CEPHFS.c 2024-04-25T13:41:35.576 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-DAOS.c 2024-04-25T13:41:35.576 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-DFS.c 2024-04-25T13:41:35.577 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-DUMMY.c 2024-04-25T13:41:35.577 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-Gfarm.c 2024-04-25T13:41:35.577 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-HDF5.c 2024-04-25T13:41:35.577 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-HDFS.c 2024-04-25T13:41:35.577 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-IME.c 2024-04-25T13:41:35.577 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-MMAP.c 2024-04-25T13:41:35.578 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-MPIIO.c 2024-04-25T13:41:35.586 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-NCMPI.c 2024-04-25T13:41:35.586 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-POSIX.c 2024-04-25T13:41:35.586 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-RADOS.c 2024-04-25T13:41:35.586 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori-S3.c 2024-04-25T13:41:35.587 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori.c 2024-04-25T13:41:35.588 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/aiori.h 2024-04-25T13:41:35.588 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/config.h.in 2024-04-25T13:41:35.588 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/ior-internal.h 2024-04-25T13:41:35.588 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/ior-main.c 2024-04-25T13:41:35.588 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/ior-output.c 2024-04-25T13:41:35.588 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/ior.c 2024-04-25T13:41:35.589 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/ior.h 2024-04-25T13:41:35.589 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/iordef.h 2024-04-25T13:41:35.589 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/mdtest-main.c 2024-04-25T13:41:35.589 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/mdtest.c 2024-04-25T13:41:35.590 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/mdtest.h 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/option.c 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/option.h 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/parse_options.c 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/parse_options.h 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/test/ 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/test/Makefile.am 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/test/Makefile.in 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/test/example.c 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/test/lib.c 2024-04-25T13:41:35.591 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/utilities.c 2024-04-25T13:41:35.592 INFO:teuthology.orchestra.run.smithi151.stdout:checking metadata... yes 2024-04-25T13:41:35.595 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/src/utilities.h 2024-04-25T13:41:35.595 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/ 2024-04-25T13:41:35.595 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/basic-tests.sh 2024-04-25T13:41:35.595 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/bug-multi-node.conf 2024-04-25T13:41:35.595 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/build/ 2024-04-25T13:41:35.595 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/build/test/ 2024-04-25T13:41:35.595 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/complex-tests.sh 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/ 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/README.md 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/centos6/ 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/centos6/Dockerfile 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/centos6/run-test.sh 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/centos7/ 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/centos7/Dockerfile 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/centos7/run-test.sh 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/ceph/ 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/ceph/NOTES 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/prepare.sh 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/run-all-tests.sh 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/ubuntu14.04/ 2024-04-25T13:41:35.596 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/ubuntu14.04/Dockerfile 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/ubuntu14.04/run-test.sh 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/ubuntu16.04/ 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/ubuntu16.04/Dockerfile 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/docker/ubuntu16.04/run-test.sh 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/ 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/ 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/3.txt 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/4.txt 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/5.txt 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/basic/ 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/basic/0.txt 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/basic/1.txt 2024-04-25T13:41:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/basic/2.txt 2024-04-25T13:41:35.598 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/mdtest-patterns/basic/3.txt 2024-04-25T13:41:35.598 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/test-lib.sh 2024-04-25T13:41:35.598 INFO:teuthology.orchestra.run.smithi191.stdout:ior-3.3.0/testing/test_comments.ior 2024-04-25T13:41:35.598 INFO:teuthology.orchestra.run.smithi191.stderr:+ cd ior-3.3.0 2024-04-25T13:41:35.598 INFO:teuthology.orchestra.run.smithi191.stderr:+ ./configure 2024-04-25T13:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout:checking metadata... yes 2024-04-25T13:41:35.850 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether the C compiler works... yes 2024-04-25T13:41:35.850 INFO:teuthology.orchestra.run.smithi097.stdout:checking for C compiler default output file name... a.out 2024-04-25T13:41:35.922 INFO:teuthology.orchestra.run.smithi097.stdout:checking for suffix of executables... 2024-04-25T13:41:36.038 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether we are cross compiling... no 2024-04-25T13:41:36.048 INFO:teuthology.orchestra.run.smithi151.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-25T13:41:36.048 INFO:teuthology.orchestra.run.smithi151.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-25T13:41:36.055 INFO:teuthology.orchestra.run.smithi151.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-25T13:41:36.057 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether build environment is sane... yes 2024-04-25T13:41:36.058 INFO:teuthology.orchestra.run.smithi097.stdout:checking for suffix of object files... o 2024-04-25T13:41:36.065 INFO:teuthology.orchestra.run.smithi151.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-25T13:41:36.065 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gawk... gawk 2024-04-25T13:41:36.071 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether make sets $(MAKE)... yes 2024-04-25T13:41:36.076 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether make supports nested variables... yes 2024-04-25T13:41:36.076 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether we are using the GNU C compiler... yes 2024-04-25T13:41:36.081 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether make supports nested variables... (cached) yes 2024-04-25T13:41:36.081 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether to enable maintainer-specific portions of Makefiles... no 2024-04-25T13:41:36.087 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether make supports the include directive... yes (GNU style) 2024-04-25T13:41:36.087 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mpicc... mpicc 2024-04-25T13:41:36.087 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc... (cached) mpicc 2024-04-25T13:41:36.094 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether mpicc accepts -g... yes 2024-04-25T13:41:36.161 INFO:teuthology.orchestra.run.smithi097.stdout:checking for mpicc option to accept ISO C89... none needed 2024-04-25T13:41:36.198 INFO:teuthology.orchestra.run.smithi097.stdout:checking whether mpicc understands -c and -o together... yes 2024-04-25T13:41:36.216 INFO:teuthology.orchestra.run.smithi191.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-25T13:41:36.216 INFO:teuthology.orchestra.run.smithi191.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-25T13:41:36.224 INFO:teuthology.orchestra.run.smithi191.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-25T13:41:36.227 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether build environment is sane... yes 2024-04-25T13:41:36.233 INFO:teuthology.orchestra.run.smithi097.stdout:checking dependency style of mpicc... gcc3 2024-04-25T13:41:36.236 INFO:teuthology.orchestra.run.smithi191.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-25T13:41:36.236 INFO:teuthology.orchestra.run.smithi191.stdout:checking for gawk... gawk 2024-04-25T13:41:36.242 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether make sets $(MAKE)... yes 2024-04-25T13:41:36.247 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether make supports nested variables... yes 2024-04-25T13:41:36.251 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether make supports nested variables... (cached) yes 2024-04-25T13:41:36.251 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether to enable maintainer-specific portions of Makefiles... no 2024-04-25T13:41:36.258 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether make supports the include directive... yes (GNU style) 2024-04-25T13:41:36.258 INFO:teuthology.orchestra.run.smithi191.stdout:checking for mpicc... mpicc 2024-04-25T13:41:36.259 INFO:teuthology.orchestra.run.smithi191.stdout:checking for gcc... (cached) mpicc 2024-04-25T13:41:36.418 INFO:teuthology.orchestra.run.smithi097.stdout:checking for function MPI_Init... yes 2024-04-25T13:41:36.472 INFO:teuthology.orchestra.run.smithi097.stdout:checking for mpi.h... yes 2024-04-25T13:41:36.473 INFO:teuthology.orchestra.run.smithi097.stdout:checking for ranlib... ranlib 2024-04-25T13:41:36.578 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether the C compiler works... yes 2024-04-25T13:41:36.578 INFO:teuthology.orchestra.run.smithi151.stdout:checking for C compiler default output file name... a.out 2024-04-25T13:41:36.606 INFO:teuthology.orchestra.run.smithi097.stdout:checking for mpicc option to accept ISO C99... none needed 2024-04-25T13:41:36.653 INFO:teuthology.orchestra.run.smithi151.stdout:checking for suffix of executables... 2024-04-25T13:41:36.669 INFO:teuthology.orchestra.run.smithi097.stdout:checking how to run the C preprocessor... mpicc -E 2024-04-25T13:41:36.703 INFO:teuthology.orchestra.run.smithi097.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-25T13:41:36.705 INFO:teuthology.orchestra.run.smithi097.stdout:checking for egrep... /usr/bin/grep -E 2024-04-25T13:41:36.763 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether the C compiler works... yes 2024-04-25T13:41:36.764 INFO:teuthology.orchestra.run.smithi191.stdout:checking for C compiler default output file name... a.out 2024-04-25T13:41:36.807 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are cross compiling... no 2024-04-25T13:41:36.829 INFO:teuthology.orchestra.run.smithi151.stdout:checking for suffix of object files... o 2024-04-25T13:41:36.835 INFO:teuthology.orchestra.run.smithi191.stdout:checking for suffix of executables... 2024-04-25T13:41:36.849 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are using the GNU C compiler... yes 2024-04-25T13:41:36.866 INFO:teuthology.orchestra.run.smithi097.stdout:checking for ANSI C header files... yes 2024-04-25T13:41:36.869 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether mpicc accepts -g... yes 2024-04-25T13:41:36.895 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sys/types.h... yes 2024-04-25T13:41:36.929 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sys/stat.h... yes 2024-04-25T13:41:36.958 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mpicc option to accept ISO C89... none needed 2024-04-25T13:41:36.962 INFO:teuthology.orchestra.run.smithi097.stdout:checking for stdlib.h... yes 2024-04-25T13:41:36.979 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether we are cross compiling... no 2024-04-25T13:41:36.995 INFO:teuthology.orchestra.run.smithi097.stdout:checking for string.h... yes 2024-04-25T13:41:37.000 INFO:teuthology.orchestra.run.smithi191.stdout:checking for suffix of object files... o 2024-04-25T13:41:37.005 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether mpicc understands -c and -o together... yes 2024-04-25T13:41:37.019 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether we are using the GNU C compiler... yes 2024-04-25T13:41:37.029 INFO:teuthology.orchestra.run.smithi097.stdout:checking for memory.h... yes 2024-04-25T13:41:37.039 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether mpicc accepts -g... yes 2024-04-25T13:41:37.050 INFO:teuthology.orchestra.run.smithi151.stdout:checking dependency style of mpicc... gcc3 2024-04-25T13:41:37.061 INFO:teuthology.orchestra.run.smithi097.stdout:checking for strings.h... yes 2024-04-25T13:41:37.096 INFO:teuthology.orchestra.run.smithi097.stdout:checking for inttypes.h... yes 2024-04-25T13:41:37.128 INFO:teuthology.orchestra.run.smithi191.stdout:checking for mpicc option to accept ISO C89... none needed 2024-04-25T13:41:37.130 INFO:teuthology.orchestra.run.smithi097.stdout:checking for stdint.h... yes 2024-04-25T13:41:37.172 INFO:teuthology.orchestra.run.smithi191.stdout:checking whether mpicc understands -c and -o together... yes 2024-04-25T13:41:37.173 INFO:teuthology.orchestra.run.smithi097.stdout:checking for unistd.h... yes 2024-04-25T13:41:37.214 INFO:teuthology.orchestra.run.smithi097.stdout:checking fcntl.h usability... yes 2024-04-25T13:41:37.215 INFO:teuthology.orchestra.run.smithi191.stdout:checking dependency style of mpicc... gcc3 2024-04-25T13:41:37.223 INFO:teuthology.orchestra.run.smithi151.stdout:checking for function MPI_Init... yes 2024-04-25T13:41:37.226 INFO:teuthology.orchestra.run.smithi097.stdout:checking fcntl.h presence... yes 2024-04-25T13:41:37.226 INFO:teuthology.orchestra.run.smithi097.stdout:checking for fcntl.h... yes 2024-04-25T13:41:37.267 INFO:teuthology.orchestra.run.smithi097.stdout:checking libintl.h usability... yes 2024-04-25T13:41:37.276 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mpi.h... yes 2024-04-25T13:41:37.277 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ranlib... ranlib 2024-04-25T13:41:37.278 INFO:teuthology.orchestra.run.smithi097.stdout:checking libintl.h presence... yes 2024-04-25T13:41:37.278 INFO:teuthology.orchestra.run.smithi097.stdout:checking for libintl.h... yes 2024-04-25T13:41:37.283 INFO:teuthology.orchestra.run.smithi097.stdout:checking for stdlib.h... (cached) yes 2024-04-25T13:41:37.288 INFO:teuthology.orchestra.run.smithi097.stdout:checking for string.h... (cached) yes 2024-04-25T13:41:37.292 INFO:teuthology.orchestra.run.smithi097.stdout:checking for strings.h... (cached) yes 2024-04-25T13:41:37.375 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mpicc option to accept ISO C99... none needed 2024-04-25T13:41:37.384 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/ioctl.h usability... yes 2024-04-25T13:41:37.394 INFO:teuthology.orchestra.run.smithi191.stdout:checking for function MPI_Init... yes 2024-04-25T13:41:37.397 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/ioctl.h presence... yes 2024-04-25T13:41:37.398 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sys/ioctl.h... yes 2024-04-25T13:41:37.438 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to run the C preprocessor... mpicc -E 2024-04-25T13:41:37.452 INFO:teuthology.orchestra.run.smithi191.stdout:checking for mpi.h... yes 2024-04-25T13:41:37.453 INFO:teuthology.orchestra.run.smithi191.stdout:checking for ranlib... ranlib 2024-04-25T13:41:37.472 INFO:teuthology.orchestra.run.smithi151.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-25T13:41:37.474 INFO:teuthology.orchestra.run.smithi151.stdout:checking for egrep... /usr/bin/grep -E 2024-04-25T13:41:37.475 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/param.h usability... yes 2024-04-25T13:41:37.494 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/param.h presence... yes 2024-04-25T13:41:37.494 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sys/param.h... yes 2024-04-25T13:41:37.537 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/statfs.h usability... yes 2024-04-25T13:41:37.549 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/statfs.h presence... yes 2024-04-25T13:41:37.549 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sys/statfs.h... yes 2024-04-25T13:41:37.550 INFO:teuthology.orchestra.run.smithi191.stdout:checking for mpicc option to accept ISO C99... none needed 2024-04-25T13:41:37.592 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/statvfs.h usability... yes 2024-04-25T13:41:37.603 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/statvfs.h presence... yes 2024-04-25T13:41:37.603 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sys/statvfs.h... yes 2024-04-25T13:41:37.644 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/time.h usability... yes 2024-04-25T13:41:37.644 INFO:teuthology.orchestra.run.smithi191.stdout:checking how to run the C preprocessor... mpicc -E 2024-04-25T13:41:37.650 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ANSI C header files... yes 2024-04-25T13:41:37.657 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/time.h presence... yes 2024-04-25T13:41:37.657 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sys/time.h... yes 2024-04-25T13:41:37.662 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sys/param.h... (cached) yes 2024-04-25T13:41:37.678 INFO:teuthology.orchestra.run.smithi191.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-25T13:41:37.680 INFO:teuthology.orchestra.run.smithi191.stdout:checking for egrep... /usr/bin/grep -E 2024-04-25T13:41:37.682 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/types.h... yes 2024-04-25T13:41:37.703 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/mount.h usability... yes 2024-04-25T13:41:37.717 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/stat.h... yes 2024-04-25T13:41:37.717 INFO:teuthology.orchestra.run.smithi097.stdout:checking sys/mount.h presence... yes 2024-04-25T13:41:37.717 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sys/mount.h... yes 2024-04-25T13:41:37.721 INFO:teuthology.orchestra.run.smithi097.stdout:checking for unistd.h... (cached) yes 2024-04-25T13:41:37.747 INFO:teuthology.orchestra.run.smithi151.stdout:checking for stdlib.h... yes 2024-04-25T13:41:37.767 INFO:teuthology.orchestra.run.smithi097.stdout:checking wchar.h usability... yes 2024-04-25T13:41:37.780 INFO:teuthology.orchestra.run.smithi097.stdout:checking wchar.h presence... yes 2024-04-25T13:41:37.780 INFO:teuthology.orchestra.run.smithi097.stdout:checking for wchar.h... yes 2024-04-25T13:41:37.784 INFO:teuthology.orchestra.run.smithi151.stdout:checking for string.h... yes 2024-04-25T13:41:37.818 INFO:teuthology.orchestra.run.smithi151.stdout:checking for memory.h... yes 2024-04-25T13:41:37.819 INFO:teuthology.orchestra.run.smithi097.stdout:checking hdfs.h usability... no 2024-04-25T13:41:37.833 INFO:teuthology.orchestra.run.smithi097.stdout:checking hdfs.h presence... no 2024-04-25T13:41:37.833 INFO:teuthology.orchestra.run.smithi097.stdout:checking for hdfs.h... no 2024-04-25T13:41:37.845 INFO:teuthology.orchestra.run.smithi191.stdout:checking for ANSI C header files... yes 2024-04-25T13:41:37.851 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strings.h... yes 2024-04-25T13:41:37.870 INFO:teuthology.orchestra.run.smithi097.stdout:checking beegfs/beegfs.h usability... no 2024-04-25T13:41:37.873 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sys/types.h... yes 2024-04-25T13:41:37.884 INFO:teuthology.orchestra.run.smithi097.stdout:checking beegfs/beegfs.h presence... no 2024-04-25T13:41:37.884 INFO:teuthology.orchestra.run.smithi097.stdout:checking for beegfs/beegfs.h... no 2024-04-25T13:41:37.884 INFO:teuthology.orchestra.run.smithi151.stdout:checking for inttypes.h... yes 2024-04-25T13:41:37.915 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sys/stat.h... yes 2024-04-25T13:41:37.917 INFO:teuthology.orchestra.run.smithi151.stdout:checking for stdint.h... yes 2024-04-25T13:41:37.947 INFO:teuthology.orchestra.run.smithi191.stdout:checking for stdlib.h... yes 2024-04-25T13:41:37.955 INFO:teuthology.orchestra.run.smithi097.stdout:checking for size_t... yes 2024-04-25T13:41:37.969 INFO:teuthology.orchestra.run.smithi151.stdout:checking for unistd.h... yes 2024-04-25T13:41:37.980 INFO:teuthology.orchestra.run.smithi191.stdout:checking for string.h... yes 2024-04-25T13:41:38.009 INFO:teuthology.orchestra.run.smithi151.stdout:checking fcntl.h usability... yes 2024-04-25T13:41:38.014 INFO:teuthology.orchestra.run.smithi191.stdout:checking for memory.h... yes 2024-04-25T13:41:38.020 INFO:teuthology.orchestra.run.smithi151.stdout:checking fcntl.h presence... yes 2024-04-25T13:41:38.020 INFO:teuthology.orchestra.run.smithi151.stdout:checking for fcntl.h... yes 2024-04-25T13:41:38.026 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sysconf... yes 2024-04-25T13:41:38.047 INFO:teuthology.orchestra.run.smithi191.stdout:checking for strings.h... yes 2024-04-25T13:41:38.060 INFO:teuthology.orchestra.run.smithi151.stdout:checking libintl.h usability... yes 2024-04-25T13:41:38.072 INFO:teuthology.orchestra.run.smithi151.stdout:checking libintl.h presence... yes 2024-04-25T13:41:38.072 INFO:teuthology.orchestra.run.smithi151.stdout:checking for libintl.h... yes 2024-04-25T13:41:38.076 INFO:teuthology.orchestra.run.smithi151.stdout:checking for stdlib.h... (cached) yes 2024-04-25T13:41:38.081 INFO:teuthology.orchestra.run.smithi151.stdout:checking for string.h... (cached) yes 2024-04-25T13:41:38.086 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strings.h... (cached) yes 2024-04-25T13:41:38.090 INFO:teuthology.orchestra.run.smithi191.stdout:checking for inttypes.h... yes 2024-04-25T13:41:38.096 INFO:teuthology.orchestra.run.smithi097.stdout:checking for gettimeofday... yes 2024-04-25T13:41:38.123 INFO:teuthology.orchestra.run.smithi191.stdout:checking for stdint.h... yes 2024-04-25T13:41:38.160 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/ioctl.h usability... yes 2024-04-25T13:41:38.168 INFO:teuthology.orchestra.run.smithi097.stdout:checking for memset... yes 2024-04-25T13:41:38.172 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/ioctl.h presence... yes 2024-04-25T13:41:38.172 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/ioctl.h... yes 2024-04-25T13:41:38.178 INFO:teuthology.orchestra.run.smithi191.stdout:checking for unistd.h... yes 2024-04-25T13:41:38.217 INFO:teuthology.orchestra.run.smithi191.stdout:checking fcntl.h usability... yes 2024-04-25T13:41:38.228 INFO:teuthology.orchestra.run.smithi191.stdout:checking fcntl.h presence... yes 2024-04-25T13:41:38.228 INFO:teuthology.orchestra.run.smithi191.stdout:checking for fcntl.h... yes 2024-04-25T13:41:38.235 INFO:teuthology.orchestra.run.smithi097.stdout:checking for mkdir... yes 2024-04-25T13:41:38.261 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/param.h usability... yes 2024-04-25T13:41:38.273 INFO:teuthology.orchestra.run.smithi191.stdout:checking libintl.h usability... yes 2024-04-25T13:41:38.277 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/param.h presence... yes 2024-04-25T13:41:38.277 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/param.h... yes 2024-04-25T13:41:38.283 INFO:teuthology.orchestra.run.smithi191.stdout:checking libintl.h presence... yes 2024-04-25T13:41:38.283 INFO:teuthology.orchestra.run.smithi191.stdout:checking for libintl.h... yes 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi191.stdout:checking for stdlib.h... (cached) yes 2024-04-25T13:41:38.293 INFO:teuthology.orchestra.run.smithi191.stdout:checking for string.h... (cached) yes 2024-04-25T13:41:38.297 INFO:teuthology.orchestra.run.smithi191.stdout:checking for strings.h... (cached) yes 2024-04-25T13:41:38.306 INFO:teuthology.orchestra.run.smithi097.stdout:checking for pow... no 2024-04-25T13:41:38.326 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/statfs.h usability... yes 2024-04-25T13:41:38.340 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/statfs.h presence... yes 2024-04-25T13:41:38.341 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/statfs.h... yes 2024-04-25T13:41:38.371 INFO:teuthology.orchestra.run.smithi097.stdout:checking for putenv... yes 2024-04-25T13:41:38.382 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/statvfs.h usability... yes 2024-04-25T13:41:38.395 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/statvfs.h presence... yes 2024-04-25T13:41:38.395 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/statvfs.h... yes 2024-04-25T13:41:38.398 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/ioctl.h usability... yes 2024-04-25T13:41:38.412 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/ioctl.h presence... yes 2024-04-25T13:41:38.412 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sys/ioctl.h... yes 2024-04-25T13:41:38.435 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/time.h usability... yes 2024-04-25T13:41:38.437 INFO:teuthology.orchestra.run.smithi097.stdout:checking for realpath... yes 2024-04-25T13:41:38.448 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/time.h presence... yes 2024-04-25T13:41:38.448 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/time.h... yes 2024-04-25T13:41:38.454 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/param.h... (cached) yes 2024-04-25T13:41:38.477 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/param.h usability... yes 2024-04-25T13:41:38.493 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/param.h presence... yes 2024-04-25T13:41:38.493 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sys/param.h... yes 2024-04-25T13:41:38.501 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/mount.h usability... yes 2024-04-25T13:41:38.502 INFO:teuthology.orchestra.run.smithi097.stdout:checking for regcomp... yes 2024-04-25T13:41:38.512 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/mount.h presence... yes 2024-04-25T13:41:38.513 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/mount.h... yes 2024-04-25T13:41:38.518 INFO:teuthology.orchestra.run.smithi151.stdout:checking for unistd.h... (cached) yes 2024-04-25T13:41:38.534 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/statfs.h usability... yes 2024-04-25T13:41:38.545 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/statfs.h presence... yes 2024-04-25T13:41:38.546 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sys/statfs.h... yes 2024-04-25T13:41:38.560 INFO:teuthology.orchestra.run.smithi151.stdout:checking wchar.h usability... yes 2024-04-25T13:41:38.569 INFO:teuthology.orchestra.run.smithi097.stdout:checking for sqrt... no 2024-04-25T13:41:38.573 INFO:teuthology.orchestra.run.smithi151.stdout:checking wchar.h presence... yes 2024-04-25T13:41:38.573 INFO:teuthology.orchestra.run.smithi151.stdout:checking for wchar.h... yes 2024-04-25T13:41:38.583 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/statvfs.h usability... yes 2024-04-25T13:41:38.595 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/statvfs.h presence... yes 2024-04-25T13:41:38.595 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sys/statvfs.h... yes 2024-04-25T13:41:38.612 INFO:teuthology.orchestra.run.smithi151.stdout:checking hdfs.h usability... no 2024-04-25T13:41:38.627 INFO:teuthology.orchestra.run.smithi151.stdout:checking hdfs.h presence... no 2024-04-25T13:41:38.627 INFO:teuthology.orchestra.run.smithi151.stdout:checking for hdfs.h... no 2024-04-25T13:41:38.633 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/time.h usability... yes 2024-04-25T13:41:38.633 INFO:teuthology.orchestra.run.smithi097.stdout:checking for strcasecmp... yes 2024-04-25T13:41:38.644 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/time.h presence... yes 2024-04-25T13:41:38.644 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sys/time.h... yes 2024-04-25T13:41:38.649 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sys/param.h... (cached) yes 2024-04-25T13:41:38.664 INFO:teuthology.orchestra.run.smithi151.stdout:checking beegfs/beegfs.h usability... no 2024-04-25T13:41:38.677 INFO:teuthology.orchestra.run.smithi151.stdout:checking beegfs/beegfs.h presence... no 2024-04-25T13:41:38.677 INFO:teuthology.orchestra.run.smithi151.stdout:checking for beegfs/beegfs.h... no 2024-04-25T13:41:38.687 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/mount.h usability... yes 2024-04-25T13:41:38.699 INFO:teuthology.orchestra.run.smithi191.stdout:checking sys/mount.h presence... yes 2024-04-25T13:41:38.699 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sys/mount.h... yes 2024-04-25T13:41:38.700 INFO:teuthology.orchestra.run.smithi097.stdout:checking for strchr... yes 2024-04-25T13:41:38.704 INFO:teuthology.orchestra.run.smithi191.stdout:checking for unistd.h... (cached) yes 2024-04-25T13:41:38.744 INFO:teuthology.orchestra.run.smithi191.stdout:checking wchar.h usability... yes 2024-04-25T13:41:38.746 INFO:teuthology.orchestra.run.smithi151.stdout:checking for size_t... yes 2024-04-25T13:41:38.756 INFO:teuthology.orchestra.run.smithi191.stdout:checking wchar.h presence... yes 2024-04-25T13:41:38.756 INFO:teuthology.orchestra.run.smithi191.stdout:checking for wchar.h... yes 2024-04-25T13:41:38.763 INFO:teuthology.orchestra.run.smithi097.stdout:checking for strerror... yes 2024-04-25T13:41:38.796 INFO:teuthology.orchestra.run.smithi191.stdout:checking hdfs.h usability... no 2024-04-25T13:41:38.809 INFO:teuthology.orchestra.run.smithi191.stdout:checking hdfs.h presence... no 2024-04-25T13:41:38.809 INFO:teuthology.orchestra.run.smithi191.stdout:checking for hdfs.h... no 2024-04-25T13:41:38.818 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sysconf... yes 2024-04-25T13:41:38.831 INFO:teuthology.orchestra.run.smithi097.stdout:checking for strncasecmp... yes 2024-04-25T13:41:38.846 INFO:teuthology.orchestra.run.smithi191.stdout:checking beegfs/beegfs.h usability... no 2024-04-25T13:41:38.861 INFO:teuthology.orchestra.run.smithi191.stdout:checking beegfs/beegfs.h presence... no 2024-04-25T13:41:38.861 INFO:teuthology.orchestra.run.smithi191.stdout:checking for beegfs/beegfs.h... no 2024-04-25T13:41:38.886 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gettimeofday... yes 2024-04-25T13:41:38.899 INFO:teuthology.orchestra.run.smithi097.stdout:checking for strstr... yes 2024-04-25T13:41:38.936 INFO:teuthology.orchestra.run.smithi191.stdout:checking for size_t... yes 2024-04-25T13:41:38.962 INFO:teuthology.orchestra.run.smithi151.stdout:checking for memset... yes 2024-04-25T13:41:38.965 INFO:teuthology.orchestra.run.smithi097.stdout:checking for uname... yes 2024-04-25T13:41:39.009 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sysconf... yes 2024-04-25T13:41:39.034 INFO:teuthology.orchestra.run.smithi097.stdout:checking for statfs... yes 2024-04-25T13:41:39.034 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mkdir... yes 2024-04-25T13:41:39.077 INFO:teuthology.orchestra.run.smithi191.stdout:checking for gettimeofday... yes 2024-04-25T13:41:39.098 INFO:teuthology.orchestra.run.smithi097.stdout:checking for statvfs... yes 2024-04-25T13:41:39.107 INFO:teuthology.orchestra.run.smithi151.stdout:checking for pow... no 2024-04-25T13:41:39.151 INFO:teuthology.orchestra.run.smithi191.stdout:checking for memset... yes 2024-04-25T13:41:39.173 INFO:teuthology.orchestra.run.smithi151.stdout:checking for putenv... yes 2024-04-25T13:41:39.219 INFO:teuthology.orchestra.run.smithi191.stdout:checking for mkdir... yes 2024-04-25T13:41:39.242 INFO:teuthology.orchestra.run.smithi151.stdout:checking for realpath... yes 2024-04-25T13:41:39.249 INFO:teuthology.orchestra.run.smithi097.stdout:checking for library containing sqrt... -lm 2024-04-25T13:41:39.281 INFO:teuthology.orchestra.run.smithi097.stdout:checking gpfs.h usability... no 2024-04-25T13:41:39.290 INFO:teuthology.orchestra.run.smithi191.stdout:checking for pow... no 2024-04-25T13:41:39.309 INFO:teuthology.orchestra.run.smithi097.stdout:checking gpfs.h presence... no 2024-04-25T13:41:39.310 INFO:teuthology.orchestra.run.smithi097.stdout:checking for gpfs.h... no 2024-04-25T13:41:39.312 INFO:teuthology.orchestra.run.smithi151.stdout:checking for regcomp... yes 2024-04-25T13:41:39.343 INFO:teuthology.orchestra.run.smithi097.stdout:checking gpfs_fcntl.h usability... no 2024-04-25T13:41:39.355 INFO:teuthology.orchestra.run.smithi097.stdout:checking gpfs_fcntl.h presence... no 2024-04-25T13:41:39.355 INFO:teuthology.orchestra.run.smithi097.stdout:checking for gpfs_fcntl.h... no 2024-04-25T13:41:39.355 INFO:teuthology.orchestra.run.smithi097.stdout:checking for special C compiler options needed for large files... no 2024-04-25T13:41:39.356 INFO:teuthology.orchestra.run.smithi191.stdout:checking for putenv... yes 2024-04-25T13:41:39.376 INFO:teuthology.orchestra.run.smithi097.stdout:checking for _FILE_OFFSET_BITS value needed for large files... no 2024-04-25T13:41:39.377 INFO:teuthology.orchestra.run.smithi097.stdout:checking for Gfarm file system... no 2024-04-25T13:41:39.386 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sqrt... no 2024-04-25T13:41:39.401 INFO:teuthology.orchestra.run.smithi097.stdout:checking that generated files are newer than configure... done 2024-04-25T13:41:39.401 INFO:teuthology.orchestra.run.smithi097.stdout:configure: creating ./config.status 2024-04-25T13:41:39.421 INFO:teuthology.orchestra.run.smithi191.stdout:checking for realpath... yes 2024-04-25T13:41:39.446 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:39.449 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:39.451 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:39.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:39.455 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:39.458 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strcasecmp... yes 2024-04-25T13:41:39.460 INFO:teuthology.orchestra.run.smithi097.stdout:config.status: creating Makefile 2024-04-25T13:41:39.469 INFO:teuthology.orchestra.run.smithi097.stdout:config.status: creating src/Makefile 2024-04-25T13:41:39.484 INFO:teuthology.orchestra.run.smithi097.stdout:config.status: creating src/test/Makefile 2024-04-25T13:41:39.494 INFO:teuthology.orchestra.run.smithi097.stdout:config.status: creating contrib/Makefile 2024-04-25T13:41:39.505 INFO:teuthology.orchestra.run.smithi097.stdout:config.status: creating doc/Makefile 2024-04-25T13:41:39.515 INFO:teuthology.orchestra.run.smithi097.stdout:config.status: creating src/config.h 2024-04-25T13:41:39.515 INFO:teuthology.orchestra.run.smithi191.stdout:checking for regcomp... yes 2024-04-25T13:41:39.524 INFO:teuthology.orchestra.run.smithi097.stdout:config.status: executing depfiles commands 2024-04-25T13:41:39.552 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strchr... yes 2024-04-25T13:41:39.586 INFO:teuthology.orchestra.run.smithi191.stdout:checking for sqrt... no 2024-04-25T13:41:39.621 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strerror... yes 2024-04-25T13:41:39.653 INFO:teuthology.orchestra.run.smithi191.stdout:checking for strcasecmp... yes 2024-04-25T13:41:39.693 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strncasecmp... yes 2024-04-25T13:41:39.721 INFO:teuthology.orchestra.run.smithi191.stdout:checking for strchr... yes 2024-04-25T13:41:39.765 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strstr... yes 2024-04-25T13:41:39.787 INFO:teuthology.orchestra.run.smithi191.stdout:checking for strerror... yes 2024-04-25T13:41:39.817 INFO:teuthology.orchestra.run.smithi097.stderr:+ make 2024-04-25T13:41:39.821 INFO:teuthology.orchestra.run.smithi097.stdout:Making all in src 2024-04-25T13:41:39.826 INFO:teuthology.orchestra.run.smithi097.stdout:make all-recursive 2024-04-25T13:41:39.832 INFO:teuthology.orchestra.run.smithi097.stdout:Making all in . 2024-04-25T13:41:39.836 INFO:teuthology.orchestra.run.smithi097.stdout: CC ior-ior-main.o 2024-04-25T13:41:39.839 INFO:teuthology.orchestra.run.smithi151.stdout:checking for uname... yes 2024-04-25T13:41:39.855 INFO:teuthology.orchestra.run.smithi191.stdout:checking for strncasecmp... yes 2024-04-25T13:41:39.910 INFO:teuthology.orchestra.run.smithi151.stdout:checking for statfs... yes 2024-04-25T13:41:39.926 INFO:teuthology.orchestra.run.smithi191.stdout:checking for strstr... yes 2024-04-25T13:41:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: CC ior-aiori.o 2024-04-25T13:41:39.979 INFO:teuthology.orchestra.run.smithi151.stdout:checking for statvfs... yes 2024-04-25T13:41:39.994 INFO:teuthology.orchestra.run.smithi191.stdout:checking for uname... yes 2024-04-25T13:41:40.062 INFO:teuthology.orchestra.run.smithi191.stdout:checking for statfs... yes 2024-04-25T13:41:40.078 INFO:teuthology.orchestra.run.smithi097.stdout: CC ior-aiori-DUMMY.o 2024-04-25T13:41:40.128 INFO:teuthology.orchestra.run.smithi191.stdout:checking for statvfs... yes 2024-04-25T13:41:40.136 INFO:teuthology.orchestra.run.smithi151.stdout:checking for library containing sqrt... -lm 2024-04-25T13:41:40.173 INFO:teuthology.orchestra.run.smithi151.stdout:checking gpfs.h usability... no 2024-04-25T13:41:40.186 INFO:teuthology.orchestra.run.smithi151.stdout:checking gpfs.h presence... no 2024-04-25T13:41:40.186 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gpfs.h... no 2024-04-25T13:41:40.197 INFO:teuthology.orchestra.run.smithi097.stdout: CC ior-aiori-MPIIO.o 2024-04-25T13:41:40.222 INFO:teuthology.orchestra.run.smithi151.stdout:checking gpfs_fcntl.h usability... no 2024-04-25T13:41:40.236 INFO:teuthology.orchestra.run.smithi151.stdout:checking gpfs_fcntl.h presence... no 2024-04-25T13:41:40.237 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gpfs_fcntl.h... no 2024-04-25T13:41:40.237 INFO:teuthology.orchestra.run.smithi151.stdout:checking for special C compiler options needed for large files... no 2024-04-25T13:41:40.258 INFO:teuthology.orchestra.run.smithi151.stdout:checking for _FILE_OFFSET_BITS value needed for large files... no 2024-04-25T13:41:40.260 INFO:teuthology.orchestra.run.smithi151.stdout:checking for Gfarm file system... no 2024-04-25T13:41:40.277 INFO:teuthology.orchestra.run.smithi191.stdout:checking for library containing sqrt... -lm 2024-04-25T13:41:40.281 INFO:teuthology.orchestra.run.smithi151.stdout:checking that generated files are newer than configure... done 2024-04-25T13:41:40.281 INFO:teuthology.orchestra.run.smithi151.stdout:configure: creating ./config.status 2024-04-25T13:41:40.311 INFO:teuthology.orchestra.run.smithi191.stdout:checking gpfs.h usability... no 2024-04-25T13:41:40.323 INFO:teuthology.orchestra.run.smithi191.stdout:checking gpfs.h presence... no 2024-04-25T13:41:40.323 INFO:teuthology.orchestra.run.smithi191.stdout:checking for gpfs.h... no 2024-04-25T13:41:40.349 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating Makefile 2024-04-25T13:41:40.358 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating src/Makefile 2024-04-25T13:41:40.359 INFO:teuthology.orchestra.run.smithi191.stdout:checking gpfs_fcntl.h usability... no 2024-04-25T13:41:40.373 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating src/test/Makefile 2024-04-25T13:41:40.374 INFO:teuthology.orchestra.run.smithi191.stdout:checking gpfs_fcntl.h presence... no 2024-04-25T13:41:40.374 INFO:teuthology.orchestra.run.smithi191.stdout:checking for gpfs_fcntl.h... no 2024-04-25T13:41:40.374 INFO:teuthology.orchestra.run.smithi191.stdout:checking for special C compiler options needed for large files... no 2024-04-25T13:41:40.388 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating contrib/Makefile 2024-04-25T13:41:40.394 INFO:teuthology.orchestra.run.smithi191.stdout:checking for _FILE_OFFSET_BITS value needed for large files... no 2024-04-25T13:41:40.396 INFO:teuthology.orchestra.run.smithi191.stdout:checking for Gfarm file system... no 2024-04-25T13:41:40.400 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating doc/Makefile 2024-04-25T13:41:40.413 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating src/config.h 2024-04-25T13:41:40.416 INFO:teuthology.orchestra.run.smithi191.stdout:checking that generated files are newer than configure... done 2024-04-25T13:41:40.416 INFO:teuthology.orchestra.run.smithi191.stdout:configure: creating ./config.status 2024-04-25T13:41:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: CC ior-aiori-MMAP.o 2024-04-25T13:41:40.424 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: executing depfiles commands 2024-04-25T13:41:40.478 INFO:teuthology.orchestra.run.smithi191.stdout:config.status: creating Makefile 2024-04-25T13:41:40.486 INFO:teuthology.orchestra.run.smithi191.stdout:config.status: creating src/Makefile 2024-04-25T13:41:40.502 INFO:teuthology.orchestra.run.smithi191.stdout:config.status: creating src/test/Makefile 2024-04-25T13:41:40.513 INFO:teuthology.orchestra.run.smithi191.stdout:config.status: creating contrib/Makefile 2024-04-25T13:41:40.524 INFO:teuthology.orchestra.run.smithi191.stdout:config.status: creating doc/Makefile 2024-04-25T13:41:40.536 INFO:teuthology.orchestra.run.smithi191.stdout:config.status: creating src/config.h 2024-04-25T13:41:40.545 INFO:teuthology.orchestra.run.smithi191.stdout:config.status: executing depfiles commands 2024-04-25T13:41:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: CC ior-aiori-POSIX.o 2024-04-25T13:41:40.729 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-ior.o 2024-04-25T13:41:40.745 INFO:teuthology.orchestra.run.smithi151.stderr:+ make 2024-04-25T13:41:40.748 INFO:teuthology.orchestra.run.smithi151.stdout:Making all in src 2024-04-25T13:41:40.753 INFO:teuthology.orchestra.run.smithi151.stdout:make all-recursive 2024-04-25T13:41:40.759 INFO:teuthology.orchestra.run.smithi151.stdout:Making all in . 2024-04-25T13:41:40.762 INFO:teuthology.orchestra.run.smithi151.stdout: CC ior-ior-main.o 2024-04-25T13:41:40.852 INFO:teuthology.orchestra.run.smithi191.stderr:+ make 2024-04-25T13:41:40.856 INFO:teuthology.orchestra.run.smithi191.stdout:Making all in src 2024-04-25T13:41:40.860 INFO:teuthology.orchestra.run.smithi191.stdout:make all-recursive 2024-04-25T13:41:40.865 INFO:teuthology.orchestra.run.smithi191.stdout:Making all in . 2024-04-25T13:41:40.869 INFO:teuthology.orchestra.run.smithi191.stdout: CC ior-ior-main.o 2024-04-25T13:41:40.871 INFO:teuthology.orchestra.run.smithi151.stdout: CC ior-aiori.o 2024-04-25T13:41:40.954 INFO:teuthology.orchestra.run.smithi191.stdout: CC ior-aiori.o 2024-04-25T13:41:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: CC ior-aiori-DUMMY.o 2024-04-25T13:41:41.086 INFO:teuthology.orchestra.run.smithi097.stderr:ior.c: In function 'GetPlatformName': 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr:ior.c:699:37: warning: ')' directive writing 1 byte into a region of size between 0 and 1023 [-Wformat-overflow=] 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr: 699 | sprintf(platformName, "%s(%s)", nodeName, sysName); 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr: from ior.c:15: 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 3 or more bytes (assuming 1026) into a destination of size 1024 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.087 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.090 INFO:teuthology.orchestra.run.smithi191.stdout: CC ior-aiori-DUMMY.o 2024-04-25T13:41:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: CC ior-aiori-MPIIO.o 2024-04-25T13:41:41.203 INFO:teuthology.orchestra.run.smithi191.stdout: CC ior-aiori-MPIIO.o 2024-04-25T13:41:41.391 INFO:teuthology.orchestra.run.smithi151.stdout: CC ior-aiori-MMAP.o 2024-04-25T13:41:41.421 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-mdtest.o 2024-04-25T13:41:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: CC ior-aiori-MMAP.o 2024-04-25T13:41:41.530 INFO:teuthology.orchestra.run.smithi151.stdout: CC ior-aiori-POSIX.o 2024-04-25T13:41:41.565 INFO:teuthology.orchestra.run.smithi191.stdout: CC ior-aiori-POSIX.o 2024-04-25T13:41:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'create_file': 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:355:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr: 355 | sprintf(curr_item, "%s/file.%s"LLU"", path, mk_name, itemNum); 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.589 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'remove_file': 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:339:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr: 339 | sprintf(curr_item, "%s/file.%s"LLU"", path, rm_name, itemNum); 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.598 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.602 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'create_remove_dirs': 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:41.603 INFO:teuthology.orchestra.run.smithi097.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.604 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'collective_helper': 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.632 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.633 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'create_remove_items': 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:509:30: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr: 509 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~ 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4118 bytes into a destination of size 4096 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.642 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'mdtest_stat': 2024-04-25T13:41:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:593:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:41.656 INFO:teuthology.orchestra.run.smithi097.stderr: 593 | sprintf(item, "file.%s"LLU"", stat_name, item_num); 2024-04-25T13:41:41.656 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~ 2024-04-25T13:41:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.656 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.656 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:614:30: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: 614 | sprintf( temp, "%s/%s", path, item ); 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.657 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:588:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: 588 | sprintf(item, "dir.%s"LLU"", stat_name, item_num); 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~ 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 6 and 4120 bytes into a destination of size 4096 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.658 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:602:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: 602 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~ 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~ 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4099) into a destination of size 4096 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.659 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:608:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~ 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~ 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:608:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~ 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-25T13:41:41.660 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.661 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.661 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.661 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.661 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.661 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.681 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'mdtest_read': 2024-04-25T13:41:41.681 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:688:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:41.681 INFO:teuthology.orchestra.run.smithi097.stderr: 688 | sprintf(item, "file.%s"LLU"", read_name, item_num); 2024-04-25T13:41:41.681 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~ 2024-04-25T13:41:41.681 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.681 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.681 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-25T13:41:41.681 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:697:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: 697 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~ 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~ 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.682 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 8213 bytes into a destination of size 4096 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:703:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~ 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~ 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:703:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:41.683 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~ 2024-04-25T13:41:41.684 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.684 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.684 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-25T13:41:41.684 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.684 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.684 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.684 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.684 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.684 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'collective_create_remove': 2024-04-25T13:41:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:775:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.703 INFO:teuthology.orchestra.run.smithi097.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.703 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:775:36: note: directive argument in the range [0, 2147483646] 2024-04-25T13:41:41.703 INFO:teuthology.orchestra.run.smithi097.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.703 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.703 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.703 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4121 bytes into a destination of size 4096 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:777:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:777:39: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.704 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:779:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:779:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.705 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:781:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:781:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.706 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:783:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:783:36: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.707 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:807:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: 807 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4112 bytes into a destination of size 4096 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.708 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:809:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:809:35: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.709 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:811:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:811:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.710 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:813:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:813:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.711 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:815:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:815:32: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.712 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:41.713 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.713 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.713 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.713 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.713 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.713 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-ior.o 2024-04-25T13:41:41.729 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'directory_test': 2024-04-25T13:41:41.729 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:843:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.729 INFO:teuthology.orchestra.run.smithi097.stderr: 843 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.730 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:873:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: 873 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.731 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.732 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:899:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: 899 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.733 INFO:teuthology.orchestra.run.smithi097.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:925:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: 925 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.735 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:948:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: 948 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.736 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.737 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-ior.o 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'file_test': 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1043:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr: 1043 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.779 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.780 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1110:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: 1110 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.781 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1133:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr: 1133 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:41.782 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.783 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1161:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: 1161 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.784 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.785 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.786 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'create_remove_directory_tree': 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1612:30: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr: 1612 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4109 bytes into a destination of size 4096 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.907 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1579:28: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: 1579 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: | ^ 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 5 or more bytes (assuming 4100) into a destination of size 4096 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.908 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.964 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c: In function 'mdtest_run': 2024-04-25T13:41:41.964 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1920:35: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-25T13:41:41.964 INFO:teuthology.orchestra.run.smithi097.stderr: 1920 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-25T13:41:41.964 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~ 2024-04-25T13:41:41.964 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.964 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.964 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-25T13:41:41.964 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.965 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.965 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.965 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.965 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.965 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1727:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr: 1727 | sprintf(unique_mk_dir, "%s.0", base_tree_name); 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.966 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1728:32: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: 1728 | sprintf(unique_chdir_dir, "%s.0", base_tree_name); 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1729:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: 1729 | sprintf(unique_stat_dir, "%s.0", base_tree_name); 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ 2024-04-25T13:41:41.967 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1730:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: 1730 | sprintf(unique_read_dir, "%s.0", base_tree_name); 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.968 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:mdtest.c:1731:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: 1731 | sprintf(unique_rm_dir, "%s.0", base_tree_name); 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: from mdtest.c:33: 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:41.969 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:41.970 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.095 INFO:teuthology.orchestra.run.smithi151.stderr:ior.c: In function 'GetPlatformName': 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr:ior.c:699:37: warning: ')' directive writing 1 byte into a region of size between 0 and 1023 [-Wformat-overflow=] 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr: 699 | sprintf(platformName, "%s(%s)", nodeName, sysName); 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr: from ior.c:15: 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 3 or more bytes (assuming 1026) into a destination of size 1024 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.096 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:ior.c: In function 'GetPlatformName': 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:ior.c:699:37: warning: ')' directive writing 1 byte into a region of size between 0 and 1023 [-Wformat-overflow=] 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr: 699 | sprintf(platformName, "%s(%s)", nodeName, sysName); 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr: from ior.c:15: 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 3 or more bytes (assuming 1026) into a destination of size 1024 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.101 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.102 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.102 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.167 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-utilities.o 2024-04-25T13:41:42.434 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-mdtest.o 2024-04-25T13:41:42.442 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-mdtest.o 2024-04-25T13:41:42.514 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-parse_options.o 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'create_file': 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:355:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi191.stderr: 355 | sprintf(curr_item, "%s/file.%s"LLU"", path, mk_name, itemNum); 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.611 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:42.611 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.611 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.611 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.611 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.611 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.611 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.619 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'remove_file': 2024-04-25T13:41:42.619 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:339:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:42.619 INFO:teuthology.orchestra.run.smithi191.stderr: 339 | sprintf(curr_item, "%s/file.%s"LLU"", path, rm_name, itemNum); 2024-04-25T13:41:42.619 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.620 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.620 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.620 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:42.620 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.620 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.620 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.620 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.620 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.620 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.624 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'create_remove_dirs': 2024-04-25T13:41:42.624 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:42.624 INFO:teuthology.orchestra.run.smithi191.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:42.625 INFO:teuthology.orchestra.run.smithi191.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.626 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.634 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'create_file': 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:355:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr: 355 | sprintf(curr_item, "%s/file.%s"LLU"", path, mk_name, itemNum); 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.635 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'remove_file': 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:339:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr: 339 | sprintf(curr_item, "%s/file.%s"LLU"", path, rm_name, itemNum); 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.645 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.646 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.646 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.646 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.650 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'create_remove_dirs': 2024-04-25T13:41:42.650 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:42.650 INFO:teuthology.orchestra.run.smithi151.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-25T13:41:42.650 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.650 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.651 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.652 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-25T13:41:42.652 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.652 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.652 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.652 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.652 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.652 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.653 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'collective_helper': 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.654 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.655 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.663 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'create_remove_items': 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:509:30: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr: 509 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~ 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4118 bytes into a destination of size 4096 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.664 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.678 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'mdtest_stat': 2024-04-25T13:41:42.678 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:593:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:42.678 INFO:teuthology.orchestra.run.smithi191.stderr: 593 | sprintf(item, "file.%s"LLU"", stat_name, item_num); 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~ 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:614:30: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: 614 | sprintf( temp, "%s/%s", path, item ); 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.679 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:588:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: 588 | sprintf(item, "dir.%s"LLU"", stat_name, item_num); 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~ 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 6 and 4120 bytes into a destination of size 4096 2024-04-25T13:41:42.680 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:602:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: 602 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~ 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~ 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4099) into a destination of size 4096 2024-04-25T13:41:42.681 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:608:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~ 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~ 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:608:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-25T13:41:42.682 INFO:teuthology.orchestra.run.smithi191.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~ 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.683 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'collective_helper': 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.684 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~ 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.685 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.693 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'create_remove_items': 2024-04-25T13:41:42.693 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:509:30: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.693 INFO:teuthology.orchestra.run.smithi151.stderr: 509 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~ 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4118 bytes into a destination of size 4096 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.694 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr:parse_options.c: In function 'createGlobalOptions': 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr:parse_options.c:469:33: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr: 469 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~ ~~~~ 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr: from parse_options.c:19: 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.696 INFO:teuthology.orchestra.run.smithi097.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.697 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.703 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'mdtest_read': 2024-04-25T13:41:42.703 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:688:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:42.703 INFO:teuthology.orchestra.run.smithi191.stderr: 688 | sprintf(item, "file.%s"LLU"", read_name, item_num); 2024-04-25T13:41:42.703 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~ 2024-04-25T13:41:42.703 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.703 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.703 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-25T13:41:42.703 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:697:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: 697 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~ 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~ 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.704 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 8213 bytes into a destination of size 4096 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:703:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~ 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~ 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:703:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~ 2024-04-25T13:41:42.705 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.706 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.706 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-25T13:41:42.706 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.706 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.706 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.706 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.706 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.706 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.709 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'mdtest_stat': 2024-04-25T13:41:42.709 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:593:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:42.709 INFO:teuthology.orchestra.run.smithi151.stderr: 593 | sprintf(item, "file.%s"LLU"", stat_name, item_num); 2024-04-25T13:41:42.709 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~ 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:614:30: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: 614 | sprintf( temp, "%s/%s", path, item ); 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.710 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:588:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: 588 | sprintf(item, "dir.%s"LLU"", stat_name, item_num); 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~ 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 6 and 4120 bytes into a destination of size 4096 2024-04-25T13:41:42.711 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:602:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: 602 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~ 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~ 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4099) into a destination of size 4096 2024-04-25T13:41:42.712 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:608:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~ 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~ 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:608:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~ 2024-04-25T13:41:42.713 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.714 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.714 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-25T13:41:42.714 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.714 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.714 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.714 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.714 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.714 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'collective_create_remove': 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:775:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:775:36: note: directive argument in the range [0, 2147483646] 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4121 bytes into a destination of size 4096 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.726 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:777:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:777:39: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.727 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:779:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:779:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.728 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:781:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:781:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.729 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:783:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:783:36: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.730 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:807:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: 807 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4112 bytes into a destination of size 4096 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:809:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.731 INFO:teuthology.orchestra.run.smithi191.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:809:35: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:811:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.732 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:811:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:813:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.733 INFO:teuthology.orchestra.run.smithi191.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:813:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.734 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:815:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:815:32: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.735 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'mdtest_read': 2024-04-25T13:41:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:688:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-25T13:41:42.736 INFO:teuthology.orchestra.run.smithi151.stderr: 688 | sprintf(item, "file.%s"LLU"", read_name, item_num); 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~ 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:697:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: 697 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~ 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:42.737 INFO:teuthology.orchestra.run.smithi151.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~ 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 8213 bytes into a destination of size 4096 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:703:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~ 2024-04-25T13:41:42.738 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: 89 | #define LLU "%lu" 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~ 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:703:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~ 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.739 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.752 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'directory_test': 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:843:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: 843 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.753 INFO:teuthology.orchestra.run.smithi191.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:873:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: 873 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.754 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.755 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:899:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: 899 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.756 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:925:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: 925 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.757 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.758 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:948:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: 948 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.759 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.760 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.761 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'collective_create_remove': 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:775:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:775:36: note: directive argument in the range [0, 2147483646] 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.762 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4121 bytes into a destination of size 4096 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:777:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:777:39: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.763 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:779:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:779:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:781:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:781:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.765 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:783:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:783:36: note: directive argument in the range [-2147483646, 2147483646] 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.766 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:807:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: 807 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4112 bytes into a destination of size 4096 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:809:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:809:35: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.768 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:811:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:811:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.769 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:813:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:813:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.770 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.771 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:815:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~ 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:815:32: note: directive argument in the range [-2147483647, 2147483647] 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi151.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.774 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.789 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'directory_test': 2024-04-25T13:41:42.789 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:843:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.789 INFO:teuthology.orchestra.run.smithi151.stderr: 843 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.789 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.789 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.789 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.790 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:873:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: 873 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.791 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.792 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:899:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: 899 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-25T13:41:42.793 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:925:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: 925 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.795 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:948:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: 948 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.796 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.797 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'file_test': 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1043:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr: 1043 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.802 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.803 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1110:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: 1110 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.804 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1133:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: 1133 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.805 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.806 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1161:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: 1161 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.807 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.808 INFO:teuthology.orchestra.run.smithi191.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-ior-output.o 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'file_test': 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1043:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: 1043 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.843 INFO:teuthology.orchestra.run.smithi151.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1110:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: 1110 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.844 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.845 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1133:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: 1133 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.846 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1161:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: 1161 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.848 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.849 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.930 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'create_remove_directory_tree': 2024-04-25T13:41:42.930 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1612:30: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.930 INFO:teuthology.orchestra.run.smithi191.stderr: 1612 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2024-04-25T13:41:42.930 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ 2024-04-25T13:41:42.930 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.930 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.930 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4109 bytes into a destination of size 4096 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1579:28: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: 1579 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: | ^ 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 5 or more bytes (assuming 4100) into a destination of size 4096 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.931 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.932 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.932 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.932 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'create_remove_directory_tree': 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1612:30: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr: 1612 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4109 bytes into a destination of size 4096 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.974 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1579:28: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: 1579 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: | ^ 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 5 or more bytes (assuming 4100) into a destination of size 4096 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.975 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.987 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c: In function 'mdtest_run': 2024-04-25T13:41:42.987 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1920:35: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-25T13:41:42.987 INFO:teuthology.orchestra.run.smithi191.stderr: 1920 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-25T13:41:42.987 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~ 2024-04-25T13:41:42.987 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.987 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.988 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-25T13:41:42.988 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.988 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.988 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.988 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.988 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.988 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.989 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1727:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.989 INFO:teuthology.orchestra.run.smithi191.stderr: 1727 | sprintf(unique_mk_dir, "%s.0", base_tree_name); 2024-04-25T13:41:42.989 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ 2024-04-25T13:41:42.989 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.989 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.989 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:42.989 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.989 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1728:32: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: 1728 | sprintf(unique_chdir_dir, "%s.0", base_tree_name); 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.990 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1729:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: 1729 | sprintf(unique_stat_dir, "%s.0", base_tree_name); 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1730:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.991 INFO:teuthology.orchestra.run.smithi191.stderr: 1730 | sprintf(unique_read_dir, "%s.0", base_tree_name); 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.992 INFO:teuthology.orchestra.run.smithi191.stderr:mdtest.c:1731:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr: 1731 | sprintf(unique_rm_dir, "%s.0", base_tree_name); 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr: from mdtest.c:33: 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:42.993 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:42.994 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.029 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c: In function 'mdtest_run': 2024-04-25T13:41:43.029 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1920:35: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-25T13:41:43.029 INFO:teuthology.orchestra.run.smithi151.stderr: 1920 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-25T13:41:43.029 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~ 2024-04-25T13:41:43.029 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:43.029 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:43.029 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-25T13:41:43.029 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1727:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr: 1727 | sprintf(unique_mk_dir, "%s.0", base_tree_name); 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1728:32: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: 1728 | sprintf(unique_chdir_dir, "%s.0", base_tree_name); 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1729:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: 1729 | sprintf(unique_stat_dir, "%s.0", base_tree_name); 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:43.032 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1730:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: 1730 | sprintf(unique_read_dir, "%s.0", base_tree_name); 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:mdtest.c:1731:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: 1731 | sprintf(unique_rm_dir, "%s.0", base_tree_name); 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: from mdtest.c:33: 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:43.035 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.119 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-option.o 2024-04-25T13:41:43.188 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-utilities.o 2024-04-25T13:41:43.219 INFO:teuthology.orchestra.run.smithi097.stderr:option.c: In function 'option_parse_token': 2024-04-25T13:41:43.219 INFO:teuthology.orchestra.run.smithi097.stderr:option.c:335:19: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2024-04-25T13:41:43.219 INFO:teuthology.orchestra.run.smithi097.stderr: 335 | arg[-1] = '='; 2024-04-25T13:41:43.219 INFO:teuthology.orchestra.run.smithi097.stderr: | ~~~~~~~~^~~~~ 2024-04-25T13:41:43.229 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-utilities.o 2024-04-25T13:41:43.278 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-aiori.o 2024-04-25T13:41:43.420 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-aiori-DUMMY.o 2024-04-25T13:41:43.525 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-parse_options.o 2024-04-25T13:41:43.534 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-aiori-MPIIO.o 2024-04-25T13:41:43.549 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-parse_options.o 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr:parse_options.c: In function 'createGlobalOptions': 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr:parse_options.c:469:33: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr: 469 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~ ~~~~ 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr: from parse_options.c:19: 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:43.706 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.707 INFO:teuthology.orchestra.run.smithi191.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:43.707 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:parse_options.c: In function 'createGlobalOptions': 2024-04-25T13:41:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:parse_options.c:469:33: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr: 469 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~ ~~~~ 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/stdio.h:894, 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr: from parse_options.c:19: 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr: 40 | __va_arg_pack ()); 2024-04-25T13:41:43.730 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-25T13:41:43.745 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-aiori-MMAP.o 2024-04-25T13:41:43.817 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-ior-output.o 2024-04-25T13:41:43.841 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-ior-output.o 2024-04-25T13:41:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: CC libaiori_a-aiori-POSIX.o 2024-04-25T13:41:44.043 INFO:teuthology.orchestra.run.smithi097.stdout: AR libaiori.a 2024-04-25T13:41:44.054 INFO:teuthology.orchestra.run.smithi097.stderr:ar: `u' modifier ignored since `D' is the default (see `U') 2024-04-25T13:41:44.074 INFO:teuthology.orchestra.run.smithi097.stdout: CCLD ior 2024-04-25T13:41:44.118 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-option.o 2024-04-25T13:41:44.130 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-option.o 2024-04-25T13:41:44.130 INFO:teuthology.orchestra.run.smithi097.stdout: CC mdtest-mdtest-main.o 2024-04-25T13:41:44.209 INFO:teuthology.orchestra.run.smithi151.stderr:option.c: In function 'option_parse_token': 2024-04-25T13:41:44.209 INFO:teuthology.orchestra.run.smithi151.stderr:option.c:335:19: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2024-04-25T13:41:44.210 INFO:teuthology.orchestra.run.smithi151.stderr: 335 | arg[-1] = '='; 2024-04-25T13:41:44.210 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~^~~~~ 2024-04-25T13:41:44.214 INFO:teuthology.orchestra.run.smithi097.stdout: CC mdtest-aiori.o 2024-04-25T13:41:44.232 INFO:teuthology.orchestra.run.smithi191.stderr:option.c: In function 'option_parse_token': 2024-04-25T13:41:44.233 INFO:teuthology.orchestra.run.smithi191.stderr:option.c:335:19: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2024-04-25T13:41:44.233 INFO:teuthology.orchestra.run.smithi191.stderr: 335 | arg[-1] = '='; 2024-04-25T13:41:44.233 INFO:teuthology.orchestra.run.smithi191.stderr: | ~~~~~~~~^~~~~ 2024-04-25T13:41:44.272 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-aiori.o 2024-04-25T13:41:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-aiori.o 2024-04-25T13:41:44.350 INFO:teuthology.orchestra.run.smithi097.stdout: CC mdtest-aiori-DUMMY.o 2024-04-25T13:41:44.411 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-aiori-DUMMY.o 2024-04-25T13:41:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-aiori-DUMMY.o 2024-04-25T13:41:44.467 INFO:teuthology.orchestra.run.smithi097.stdout: CC mdtest-aiori-MPIIO.o 2024-04-25T13:41:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-aiori-MPIIO.o 2024-04-25T13:41:44.548 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-aiori-MPIIO.o 2024-04-25T13:41:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: CC mdtest-aiori-MMAP.o 2024-04-25T13:41:44.755 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-aiori-MMAP.o 2024-04-25T13:41:44.772 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-aiori-MMAP.o 2024-04-25T13:41:44.794 INFO:teuthology.orchestra.run.smithi097.stdout: CC mdtest-aiori-POSIX.o 2024-04-25T13:41:44.886 INFO:teuthology.orchestra.run.smithi151.stdout: CC libaiori_a-aiori-POSIX.o 2024-04-25T13:41:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: CC libaiori_a-aiori-POSIX.o 2024-04-25T13:41:44.972 INFO:teuthology.orchestra.run.smithi097.stdout: CCLD mdtest 2024-04-25T13:41:45.031 INFO:teuthology.orchestra.run.smithi097.stdout:Making all in test 2024-04-25T13:41:45.033 INFO:teuthology.orchestra.run.smithi097.stdout:make[3]: Nothing to be done for 'all'. 2024-04-25T13:41:45.034 INFO:teuthology.orchestra.run.smithi097.stdout:Making all in doc 2024-04-25T13:41:45.036 INFO:teuthology.orchestra.run.smithi097.stdout:make[1]: Nothing to be done for 'all'. 2024-04-25T13:41:45.036 INFO:teuthology.orchestra.run.smithi097.stdout:Making all in contrib 2024-04-25T13:41:45.039 INFO:teuthology.orchestra.run.smithi097.stdout: CC cbif.o 2024-04-25T13:41:45.064 INFO:teuthology.orchestra.run.smithi151.stdout: AR libaiori.a 2024-04-25T13:41:45.066 INFO:teuthology.orchestra.run.smithi191.stdout: AR libaiori.a 2024-04-25T13:41:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:ar: `u' modifier ignored since `D' is the default (see `U') 2024-04-25T13:41:45.080 INFO:teuthology.orchestra.run.smithi191.stderr:ar: `u' modifier ignored since `D' is the default (see `U') 2024-04-25T13:41:45.102 INFO:teuthology.orchestra.run.smithi151.stdout: CCLD ior 2024-04-25T13:41:45.106 INFO:teuthology.orchestra.run.smithi191.stdout: CCLD ior 2024-04-25T13:41:45.121 INFO:teuthology.orchestra.run.smithi097.stdout: CCLD cbif 2024-04-25T13:41:45.147 INFO:teuthology.orchestra.run.smithi097.stdout:make[1]: Nothing to be done for 'all-am'. 2024-04-25T13:41:45.147 INFO:teuthology.orchestra.run.smithi097.stderr:+ make install DESTDIR=/home/ubuntu/cephtest/binary/ 2024-04-25T13:41:45.151 INFO:teuthology.orchestra.run.smithi097.stdout:Making install in src 2024-04-25T13:41:45.154 INFO:teuthology.orchestra.run.smithi151.stdout: CC mdtest-mdtest-main.o 2024-04-25T13:41:45.161 INFO:teuthology.orchestra.run.smithi097.stdout:Making install in . 2024-04-25T13:41:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: CC mdtest-mdtest-main.o 2024-04-25T13:41:45.202 INFO:teuthology.orchestra.run.smithi097.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-25T13:41:45.205 INFO:teuthology.orchestra.run.smithi097.stdout: /usr/bin/install -c ior mdtest '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-25T13:41:45.208 INFO:teuthology.orchestra.run.smithi097.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-25T13:41:45.209 INFO:teuthology.orchestra.run.smithi097.stdout: /usr/bin/install -c -m 644 libaiori.a '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-25T13:41:45.213 INFO:teuthology.orchestra.run.smithi097.stdout: ( cd '/home/ubuntu/cephtest/binary//usr/local/lib' && ranlib libaiori.a ) 2024-04-25T13:41:45.219 INFO:teuthology.orchestra.run.smithi097.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:45.219 INFO:teuthology.orchestra.run.smithi097.stdout:Making install in test 2024-04-25T13:41:45.223 INFO:teuthology.orchestra.run.smithi097.stdout:make[3]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:45.223 INFO:teuthology.orchestra.run.smithi097.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:45.223 INFO:teuthology.orchestra.run.smithi097.stdout:Making install in doc 2024-04-25T13:41:45.226 INFO:teuthology.orchestra.run.smithi097.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:45.227 INFO:teuthology.orchestra.run.smithi097.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-25T13:41:45.229 INFO:teuthology.orchestra.run.smithi097.stdout: /usr/bin/install -c -m 644 USER_GUIDE '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-25T13:41:45.232 INFO:teuthology.orchestra.run.smithi097.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-25T13:41:45.235 INFO:teuthology.orchestra.run.smithi097.stdout: /usr/bin/install -c -m 644 mdtest.1 '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-25T13:41:45.236 INFO:teuthology.orchestra.run.smithi151.stdout: CC mdtest-aiori.o 2024-04-25T13:41:45.237 INFO:teuthology.orchestra.run.smithi097.stdout:Making install in contrib 2024-04-25T13:41:45.242 INFO:teuthology.orchestra.run.smithi097.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:45.243 INFO:teuthology.orchestra.run.smithi097.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:45.246 INFO:teuthology.orchestra.run.smithi097.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:45.246 INFO:teuthology.orchestra.run.smithi097.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:45.246 INFO:teuthology.orchestra.run.smithi097.stderr:+ cd /home/ubuntu/cephtest/ 2024-04-25T13:41:45.246 INFO:teuthology.orchestra.run.smithi097.stderr:+ sudo apt install -y tree 2024-04-25T13:41:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: CC mdtest-aiori.o 2024-04-25T13:41:45.254 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:41:45.254 INFO:teuthology.orchestra.run.smithi097.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-25T13:41:45.254 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:41:45.297 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-25T13:41:45.382 INFO:teuthology.orchestra.run.smithi151.stdout: CC mdtest-aiori-DUMMY.o 2024-04-25T13:41:45.390 INFO:teuthology.orchestra.run.smithi191.stdout: CC mdtest-aiori-DUMMY.o 2024-04-25T13:41:45.494 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-25T13:41:45.495 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-25T13:41:45.501 INFO:teuthology.orchestra.run.smithi151.stdout: CC mdtest-aiori-MPIIO.o 2024-04-25T13:41:45.512 INFO:teuthology.orchestra.run.smithi191.stdout: CC mdtest-aiori-MPIIO.o 2024-04-25T13:41:45.684 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:41:45.684 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:41:45.684 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:41:45.684 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:41:45.684 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:41:45.685 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:41:45.685 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:41:45.714 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-25T13:41:45.715 INFO:teuthology.orchestra.run.smithi097.stdout: tree 2024-04-25T13:41:45.718 INFO:teuthology.orchestra.run.smithi151.stdout: CC mdtest-aiori-MMAP.o 2024-04-25T13:41:45.723 INFO:teuthology.orchestra.run.smithi191.stdout: CC mdtest-aiori-MMAP.o 2024-04-25T13:41:45.774 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 1 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:41:45.774 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 47.9 kB of archives. 2024-04-25T13:41:45.774 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 116 kB of additional disk space will be used. 2024-04-25T13:41:45.775 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 tree amd64 2.0.2-1 [47.9 kB] 2024-04-25T13:41:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: CC mdtest-aiori-POSIX.o 2024-04-25T13:41:45.850 INFO:teuthology.orchestra.run.smithi151.stdout: CC mdtest-aiori-POSIX.o 2024-04-25T13:41:46.028 INFO:teuthology.orchestra.run.smithi191.stdout: CCLD mdtest 2024-04-25T13:41:46.029 INFO:teuthology.orchestra.run.smithi151.stdout: CCLD mdtest 2024-04-25T13:41:46.057 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: unable to initialize frontend: Dialog 2024-04-25T13:41:46.057 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-25T13:41:46.057 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: falling back to frontend: Readline 2024-04-25T13:41:46.063 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: unable to initialize frontend: Readline 2024-04-25T13:41:46.063 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-25T13:41:46.063 INFO:teuthology.orchestra.run.smithi097.stderr:debconf: falling back to frontend: Teletype 2024-04-25T13:41:46.067 INFO:teuthology.orchestra.run.smithi097.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-25T13:41:46.090 INFO:teuthology.orchestra.run.smithi151.stdout:Making all in test 2024-04-25T13:41:46.091 INFO:teuthology.orchestra.run.smithi191.stdout:Making all in test 2024-04-25T13:41:46.092 INFO:teuthology.orchestra.run.smithi151.stdout:make[3]: Nothing to be done for 'all'. 2024-04-25T13:41:46.093 INFO:teuthology.orchestra.run.smithi191.stdout:make[3]: Nothing to be done for 'all'. 2024-04-25T13:41:46.093 INFO:teuthology.orchestra.run.smithi151.stdout:Making all in doc 2024-04-25T13:41:46.094 INFO:teuthology.orchestra.run.smithi191.stdout:Making all in doc 2024-04-25T13:41:46.095 INFO:teuthology.orchestra.run.smithi151.stdout:make[1]: Nothing to be done for 'all'. 2024-04-25T13:41:46.096 INFO:teuthology.orchestra.run.smithi151.stdout:Making all in contrib 2024-04-25T13:41:46.096 INFO:teuthology.orchestra.run.smithi191.stdout:make[1]: Nothing to be done for 'all'. 2024-04-25T13:41:46.096 INFO:teuthology.orchestra.run.smithi191.stdout:Making all in contrib 2024-04-25T13:41:46.098 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 47.9 kB in 0s (511 kB/s) 2024-04-25T13:41:46.098 INFO:teuthology.orchestra.run.smithi151.stdout: CC cbif.o 2024-04-25T13:41:46.099 INFO:teuthology.orchestra.run.smithi191.stdout: CC cbif.o 2024-04-25T13:41:46.163 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tree. 2024-04-25T13:41:46.181 INFO:teuthology.orchestra.run.smithi151.stdout: CCLD cbif 2024-04-25T13:41:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: CCLD cbif 2024-04-25T13:41:46.208 INFO:teuthology.orchestra.run.smithi151.stdout:make[1]: Nothing to be done for 'all-am'. 2024-04-25T13:41:46.208 INFO:teuthology.orchestra.run.smithi151.stderr:+ make install DESTDIR=/home/ubuntu/cephtest/binary/ 2024-04-25T13:41:46.212 INFO:teuthology.orchestra.run.smithi151.stdout:Making install in src 2024-04-25T13:41:46.217 INFO:teuthology.orchestra.run.smithi191.stdout:make[1]: Nothing to be done for 'all-am'. 2024-04-25T13:41:46.217 INFO:teuthology.orchestra.run.smithi191.stderr:+ make install DESTDIR=/home/ubuntu/cephtest/binary/ 2024-04-25T13:41:46.222 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176797 files and directories currently installed.) 2024-04-25T13:41:46.222 INFO:teuthology.orchestra.run.smithi191.stdout:Making install in src 2024-04-25T13:41:46.223 INFO:teuthology.orchestra.run.smithi151.stdout:Making install in . 2024-04-25T13:41:46.227 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../tree_2.0.2-1_amd64.deb ... 2024-04-25T13:41:46.236 INFO:teuthology.orchestra.run.smithi191.stdout:Making install in . 2024-04-25T13:41:46.270 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tree (2.0.2-1) ... 2024-04-25T13:41:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-25T13:41:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: /usr/bin/install -c ior mdtest '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-25T13:41:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-25T13:41:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: /usr/bin/install -c -m 644 libaiori.a '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-25T13:41:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: ( cd '/home/ubuntu/cephtest/binary//usr/local/lib' && ranlib libaiori.a ) 2024-04-25T13:41:46.291 INFO:teuthology.orchestra.run.smithi191.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-25T13:41:46.294 INFO:teuthology.orchestra.run.smithi191.stdout: /usr/bin/install -c ior mdtest '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-25T13:41:46.294 INFO:teuthology.orchestra.run.smithi151.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:46.295 INFO:teuthology.orchestra.run.smithi151.stdout:Making install in test 2024-04-25T13:41:46.297 INFO:teuthology.orchestra.run.smithi191.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-25T13:41:46.298 INFO:teuthology.orchestra.run.smithi151.stdout:make[3]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:46.298 INFO:teuthology.orchestra.run.smithi151.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:46.299 INFO:teuthology.orchestra.run.smithi191.stdout: /usr/bin/install -c -m 644 libaiori.a '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-25T13:41:46.299 INFO:teuthology.orchestra.run.smithi151.stdout:Making install in doc 2024-04-25T13:41:46.302 INFO:teuthology.orchestra.run.smithi151.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:46.303 INFO:teuthology.orchestra.run.smithi191.stdout: ( cd '/home/ubuntu/cephtest/binary//usr/local/lib' && ranlib libaiori.a ) 2024-04-25T13:41:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-25T13:41:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: /usr/bin/install -c -m 644 USER_GUIDE '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-25T13:41:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-25T13:41:46.309 INFO:teuthology.orchestra.run.smithi191.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:46.310 INFO:teuthology.orchestra.run.smithi191.stdout:Making install in test 2024-04-25T13:41:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: /usr/bin/install -c -m 644 mdtest.1 '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-25T13:41:46.312 INFO:teuthology.orchestra.run.smithi151.stdout:Making install in contrib 2024-04-25T13:41:46.315 INFO:teuthology.orchestra.run.smithi191.stdout:make[3]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:46.316 INFO:teuthology.orchestra.run.smithi191.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:46.317 INFO:teuthology.orchestra.run.smithi191.stdout:Making install in doc 2024-04-25T13:41:46.318 INFO:teuthology.orchestra.run.smithi151.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:46.318 INFO:teuthology.orchestra.run.smithi151.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:46.320 INFO:teuthology.orchestra.run.smithi191.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:46.320 INFO:teuthology.orchestra.run.smithi191.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-25T13:41:46.321 INFO:teuthology.orchestra.run.smithi151.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:46.321 INFO:teuthology.orchestra.run.smithi151.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:46.322 INFO:teuthology.orchestra.run.smithi151.stderr:+ cd /home/ubuntu/cephtest/ 2024-04-25T13:41:46.322 INFO:teuthology.orchestra.run.smithi151.stderr:+ sudo apt install -y tree 2024-04-25T13:41:46.323 INFO:teuthology.orchestra.run.smithi191.stdout: /usr/bin/install -c -m 644 USER_GUIDE '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-25T13:41:46.326 INFO:teuthology.orchestra.run.smithi191.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-25T13:41:46.330 INFO:teuthology.orchestra.run.smithi191.stdout: /usr/bin/install -c -m 644 mdtest.1 '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-25T13:41:46.330 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:41:46.330 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-25T13:41:46.330 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:41:46.332 INFO:teuthology.orchestra.run.smithi191.stdout:Making install in contrib 2024-04-25T13:41:46.339 INFO:teuthology.orchestra.run.smithi191.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:46.339 INFO:teuthology.orchestra.run.smithi191.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:46.342 INFO:teuthology.orchestra.run.smithi191.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-25T13:41:46.342 INFO:teuthology.orchestra.run.smithi191.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-25T13:41:46.343 INFO:teuthology.orchestra.run.smithi191.stderr:+ cd /home/ubuntu/cephtest/ 2024-04-25T13:41:46.343 INFO:teuthology.orchestra.run.smithi191.stderr:+ sudo apt install -y tree 2024-04-25T13:41:46.351 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:41:46.351 INFO:teuthology.orchestra.run.smithi191.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-25T13:41:46.351 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:41:46.371 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-04-25T13:41:46.392 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-25T13:41:46.566 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-04-25T13:41:46.567 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-04-25T13:41:46.593 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-25T13:41:46.594 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-25T13:41:46.631 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tree (2.0.2-1) ... 2024-04-25T13:41:46.734 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:41:46.734 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:41:46.735 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:41:46.735 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:41:46.735 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:41:46.735 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:41:46.735 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:41:46.759 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:46.763 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:41:46.763 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:41:46.763 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:41:46.763 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:41:46.763 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:41:46.764 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-04-25T13:41:46.764 INFO:teuthology.orchestra.run.smithi151.stdout: tree 2024-04-25T13:41:46.764 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:41:46.764 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:41:46.790 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2024-04-25T13:41:46.791 INFO:teuthology.orchestra.run.smithi191.stdout: tree 2024-04-25T13:41:46.830 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 1 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:41:46.830 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 47.9 kB of archives. 2024-04-25T13:41:46.831 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 116 kB of additional disk space will be used. 2024-04-25T13:41:46.831 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 tree amd64 2.0.2-1 [47.9 kB] 2024-04-25T13:41:46.852 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 1 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T13:41:46.852 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 47.9 kB of archives. 2024-04-25T13:41:46.852 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 116 kB of additional disk space will be used. 2024-04-25T13:41:46.852 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 tree amd64 2.0.2-1 [47.9 kB] 2024-04-25T13:41:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: unable to initialize frontend: Dialog 2024-04-25T13:41:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-25T13:41:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: falling back to frontend: Readline 2024-04-25T13:41:47.114 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: unable to initialize frontend: Readline 2024-04-25T13:41:47.114 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-25T13:41:47.114 INFO:teuthology.orchestra.run.smithi151.stderr:debconf: falling back to frontend: Teletype 2024-04-25T13:41:47.118 INFO:teuthology.orchestra.run.smithi151.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-25T13:41:47.125 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: unable to initialize frontend: Dialog 2024-04-25T13:41:47.126 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-25T13:41:47.126 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: falling back to frontend: Readline 2024-04-25T13:41:47.132 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: unable to initialize frontend: Readline 2024-04-25T13:41:47.132 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-25T13:41:47.132 INFO:teuthology.orchestra.run.smithi191.stderr:debconf: falling back to frontend: Teletype 2024-04-25T13:41:47.135 INFO:teuthology.orchestra.run.smithi191.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-25T13:41:47.148 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 47.9 kB in 0s (463 kB/s) 2024-04-25T13:41:47.165 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 47.9 kB in 0s (496 kB/s) 2024-04-25T13:41:47.237 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package tree. 2024-04-25T13:41:47.266 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package tree. 2024-04-25T13:41:47.318 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176797 files and directories currently installed.) 2024-04-25T13:41:47.324 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../tree_2.0.2-1_amd64.deb ... 2024-04-25T13:41:47.353 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176797 files and directories currently installed.) 2024-04-25T13:41:47.359 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../tree_2.0.2-1_amd64.deb ... 2024-04-25T13:41:47.377 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking tree (2.0.2-1) ... 2024-04-25T13:41:47.407 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking tree (2.0.2-1) ... 2024-04-25T13:41:47.746 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up tree (2.0.2-1) ... 2024-04-25T13:41:47.777 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up tree (2.0.2-1) ... 2024-04-25T13:41:47.865 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:47.905 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:48.310 INFO:teuthology.orchestra.run.smithi097.stderr:+ tree binary/ 2024-04-25T13:41:48.310 INFO:teuthology.orchestra.run.smithi097.stdout:binary/ 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout:`-- usr 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: `-- local 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: |-- bin 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: | |-- ior 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: | `-- mdtest 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: |-- lib 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: | `-- libaiori.a 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: `-- share 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: |-- man 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: | `-- man1 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: | `-- mdtest.1 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: `-- USER_GUIDE 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:41:48.311 INFO:teuthology.orchestra.run.smithi097.stdout:7 directories, 5 files 2024-04-25T13:41:48.312 INFO:teuthology.orchestra.run.smithi097.stderr:+ rm ior-3.3.0.tar.bz2 2024-04-25T13:41:48.312 INFO:teuthology.orchestra.run.smithi097.stderr:+ rm -r ior-3.3.0 2024-04-25T13:41:48.316 INFO:teuthology.orchestra.run.smithi097.stderr:+ ln -s /home/ubuntu/cephtest/mnt.0 /home/ubuntu/cephtest/gmnt 2024-04-25T13:41:48.318 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:49.368 INFO:teuthology.orchestra.run.smithi151.stderr:+ tree binary/ 2024-04-25T13:41:49.369 INFO:teuthology.orchestra.run.smithi151.stdout:binary/ 2024-04-25T13:41:49.369 INFO:teuthology.orchestra.run.smithi151.stdout:`-- usr 2024-04-25T13:41:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: `-- local 2024-04-25T13:41:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: |-- bin 2024-04-25T13:41:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: | |-- ior 2024-04-25T13:41:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: | `-- mdtest 2024-04-25T13:41:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: |-- lib 2024-04-25T13:41:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: | `-- libaiori.a 2024-04-25T13:41:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: `-- share 2024-04-25T13:41:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: |-- man 2024-04-25T13:41:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: | `-- man1 2024-04-25T13:41:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: | `-- mdtest.1 2024-04-25T13:41:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: `-- USER_GUIDE 2024-04-25T13:41:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T13:41:49.370 INFO:teuthology.orchestra.run.smithi151.stdout:7 directories, 5 files 2024-04-25T13:41:49.370 INFO:teuthology.orchestra.run.smithi151.stderr:+ rm ior-3.3.0.tar.bz2 2024-04-25T13:41:49.371 INFO:teuthology.orchestra.run.smithi151.stderr:+ rm -r ior-3.3.0 2024-04-25T13:41:49.374 INFO:teuthology.orchestra.run.smithi151.stderr:+ ln -s /home/ubuntu/cephtest/mnt.1 /home/ubuntu/cephtest/gmnt 2024-04-25T13:41:49.376 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:49.390 INFO:teuthology.orchestra.run.smithi191.stderr:+ tree binary/ 2024-04-25T13:41:49.391 INFO:teuthology.orchestra.run.smithi191.stdout:binary/ 2024-04-25T13:41:49.391 INFO:teuthology.orchestra.run.smithi191.stdout:`-- usr 2024-04-25T13:41:49.391 INFO:teuthology.orchestra.run.smithi191.stdout: `-- local 2024-04-25T13:41:49.391 INFO:teuthology.orchestra.run.smithi191.stdout: |-- bin 2024-04-25T13:41:49.391 INFO:teuthology.orchestra.run.smithi191.stdout: | |-- ior 2024-04-25T13:41:49.391 INFO:teuthology.orchestra.run.smithi191.stdout: | `-- mdtest 2024-04-25T13:41:49.391 INFO:teuthology.orchestra.run.smithi191.stdout: |-- lib 2024-04-25T13:41:49.392 INFO:teuthology.orchestra.run.smithi191.stdout: | `-- libaiori.a 2024-04-25T13:41:49.392 INFO:teuthology.orchestra.run.smithi191.stdout: `-- share 2024-04-25T13:41:49.392 INFO:teuthology.orchestra.run.smithi191.stdout: |-- man 2024-04-25T13:41:49.392 INFO:teuthology.orchestra.run.smithi191.stdout: | `-- man1 2024-04-25T13:41:49.392 INFO:teuthology.orchestra.run.smithi191.stdout: | `-- mdtest.1 2024-04-25T13:41:49.392 INFO:teuthology.orchestra.run.smithi191.stdout: `-- USER_GUIDE 2024-04-25T13:41:49.392 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:41:49.392 INFO:teuthology.orchestra.run.smithi191.stdout:7 directories, 5 files 2024-04-25T13:41:49.392 INFO:teuthology.orchestra.run.smithi191.stderr:+ rm ior-3.3.0.tar.bz2 2024-04-25T13:41:49.393 INFO:teuthology.orchestra.run.smithi191.stderr:+ rm -r ior-3.3.0 2024-04-25T13:41:49.398 INFO:teuthology.orchestra.run.smithi191.stderr:+ ln -s /home/ubuntu/cephtest/mnt.2 /home/ubuntu/cephtest/gmnt 2024-04-25T13:41:49.400 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:49.400 INFO:teuthology.run_tasks:Running task ssh_keys... 2024-04-25T13:41:49.493 DEBUG:teuthology.orchestra.run.smithi077:> echo 'StrictHostKeyChecking no 2024-04-25T13:41:49.493 DEBUG:teuthology.orchestra.run.smithi077:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2024-04-25T13:41:49.496 DEBUG:teuthology.orchestra.run.smithi096:> echo 'StrictHostKeyChecking no 2024-04-25T13:41:49.496 DEBUG:teuthology.orchestra.run.smithi096:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2024-04-25T13:41:49.498 DEBUG:teuthology.orchestra.run.smithi097:> echo 'StrictHostKeyChecking no 2024-04-25T13:41:49.498 DEBUG:teuthology.orchestra.run.smithi097:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2024-04-25T13:41:49.501 DEBUG:teuthology.orchestra.run.smithi151:> echo 'StrictHostKeyChecking no 2024-04-25T13:41:49.501 DEBUG:teuthology.orchestra.run.smithi151:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2024-04-25T13:41:49.504 DEBUG:teuthology.orchestra.run.smithi191:> echo 'StrictHostKeyChecking no 2024-04-25T13:41:49.504 DEBUG:teuthology.orchestra.run.smithi191:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2024-04-25T13:41:49.510 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQDpJ8nr1smcjNQee+fNwNSvNuQfOq0yONLoujW6i74oTwSGQIIBKSvBotv8umdwKNJlp9B/LcKTGGXE7jMRI5b/EWlZH2ZXQoKUNkhe+dAaPe3rD/vTUbDhHrI2arbBgzpxt3gKffqA3nOEcqaU387iLxhIRpUnu/L9zdm0OAB0THpfovID0/900kqo1dhmeox+yn+VPjn6vNImxqLXWvsMP9xlxfccV7UkbM0bxBQA0HKpV3hYoe+ii0P87JnKGgoAeVk1tWo7Ak8Np58LXYieky1HdLHIL4VrMfzMEYgfhlt+7oHbNwr2ETvPj/mY8EYhadTqm3fAEePtAlCojKTP 2024-04-25T13:41:49.511 INFO:teuthology.task.ssh_keys:pushing keys to smithi077.front.sepia.ceph.com for ubuntu 2024-04-25T13:41:49.511 DEBUG:teuthology.orchestra.run.smithi077:> rm -f -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:49.548 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:41:49.549 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:49.549 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:49.599 DEBUG:teuthology.orchestra.run.smithi077:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:49.645 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:41:49.645 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:49.692 DEBUG:teuthology.orchestra.run.smithi077:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:49:692778 2024-04-25T13:41:49.741 INFO:teuthology.orchestra.run.smithi077.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:49:692778' 2024-04-25T13:41:49.742 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T13:41:49.742 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2024-04-25T13:41:49.789 INFO:teuthology.task.ssh_keys:pushing keys to smithi096.front.sepia.ceph.com for ubuntu 2024-04-25T13:41:49.789 DEBUG:teuthology.orchestra.run.smithi096:> rm -f -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:49.795 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:41:49.795 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:49.795 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:49.844 DEBUG:teuthology.orchestra.run.smithi096:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:49.894 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:41:49.894 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:49.942 DEBUG:teuthology.orchestra.run.smithi096:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:49:942537 2024-04-25T13:41:49.991 INFO:teuthology.orchestra.run.smithi096.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:49:942537' 2024-04-25T13:41:49.991 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-25T13:41:49.991 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2024-04-25T13:41:50.043 INFO:teuthology.task.ssh_keys:pushing keys to smithi097.front.sepia.ceph.com for ubuntu 2024-04-25T13:41:50.043 DEBUG:teuthology.orchestra.run.smithi097:> rm -f -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:50.048 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:41:50.048 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:50.049 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:50.099 DEBUG:teuthology.orchestra.run.smithi097:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:50.145 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:41:50.145 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:50.193 DEBUG:teuthology.orchestra.run.smithi097:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:50:193665 2024-04-25T13:41:50.242 INFO:teuthology.orchestra.run.smithi097.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:50:193665' 2024-04-25T13:41:50.242 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:41:50.242 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2024-04-25T13:41:50.289 INFO:teuthology.task.ssh_keys:pushing keys to smithi151.front.sepia.ceph.com for ubuntu 2024-04-25T13:41:50.289 DEBUG:teuthology.orchestra.run.smithi151:> rm -f -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:50.295 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:41:50.295 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:50.295 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:50.343 DEBUG:teuthology.orchestra.run.smithi151:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:50.390 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:41:50.390 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:50.437 DEBUG:teuthology.orchestra.run.smithi151:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:50:437715 2024-04-25T13:41:50.486 INFO:teuthology.orchestra.run.smithi151.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:50:437715' 2024-04-25T13:41:50.487 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:41:50.487 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2024-04-25T13:41:50.534 INFO:teuthology.task.ssh_keys:pushing keys to smithi191.front.sepia.ceph.com for ubuntu 2024-04-25T13:41:50.534 DEBUG:teuthology.orchestra.run.smithi191:> rm -f -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:50.540 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:41:50.540 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:50.540 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2024-04-25T13:41:50.589 DEBUG:teuthology.orchestra.run.smithi191:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:50.636 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:41:50.636 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:41:50.684 DEBUG:teuthology.orchestra.run.smithi191:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:50:684205 2024-04-25T13:41:50.733 INFO:teuthology.orchestra.run.smithi191.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:50:684205' 2024-04-25T13:41:50.733 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:41:50.733 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2024-04-25T13:41:50.781 INFO:teuthology.run_tasks:Running task mpi... 2024-04-25T13:41:50.810 DEBUG:teuthology.orchestra.run.smithi097:> mpiexec --version 2024-04-25T13:41:50.839 INFO:teuthology.orchestra.run.smithi097.stdout:HYDRA build details: 2024-04-25T13:41:50.839 INFO:teuthology.orchestra.run.smithi097.stdout: Version: 4.0 2024-04-25T13:41:50.840 INFO:teuthology.orchestra.run.smithi097.stdout: Release Date: Fri Jan 21 10:42:29 CST 2022 2024-04-25T13:41:50.840 INFO:teuthology.orchestra.run.smithi097.stdout: CC: gcc -Wdate-time -D_FORTIFY_SOURCE=2 -g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro 2024-04-25T13:41:50.840 INFO:teuthology.orchestra.run.smithi097.stdout: Configure options: '--with-hwloc-prefix=/usr' '--with-device=ch4:ofi' 'FFLAGS=-O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -fallow-invalid-boz -fallow-argument-mismatch' '--prefix=/usr' 'CFLAGS=-g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security' 'LDFLAGS=-Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' 2024-04-25T13:41:50.840 INFO:teuthology.orchestra.run.smithi097.stdout: Process Manager: pmi 2024-04-25T13:41:50.840 INFO:teuthology.orchestra.run.smithi097.stdout: Launchers available: ssh rsh fork slurm ll lsf sge manual persist 2024-04-25T13:41:50.840 INFO:teuthology.orchestra.run.smithi097.stdout: Topology libraries available: hwloc 2024-04-25T13:41:50.840 INFO:teuthology.orchestra.run.smithi097.stdout: Resource management kernels available: user slurm ll lsf sge pbs cobalt 2024-04-25T13:41:50.840 INFO:teuthology.orchestra.run.smithi097.stdout: Demux engines available: poll select 2024-04-25T13:41:50.841 DEBUG:teuthology.orchestra.run.smithi151:> mpiexec --version 2024-04-25T13:41:50.882 INFO:teuthology.orchestra.run.smithi151.stdout:HYDRA build details: 2024-04-25T13:41:50.883 INFO:teuthology.orchestra.run.smithi151.stdout: Version: 4.0 2024-04-25T13:41:50.883 INFO:teuthology.orchestra.run.smithi151.stdout: Release Date: Fri Jan 21 10:42:29 CST 2022 2024-04-25T13:41:50.883 INFO:teuthology.orchestra.run.smithi151.stdout: CC: gcc -Wdate-time -D_FORTIFY_SOURCE=2 -g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro 2024-04-25T13:41:50.883 INFO:teuthology.orchestra.run.smithi151.stdout: Configure options: '--with-hwloc-prefix=/usr' '--with-device=ch4:ofi' 'FFLAGS=-O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -fallow-invalid-boz -fallow-argument-mismatch' '--prefix=/usr' 'CFLAGS=-g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security' 'LDFLAGS=-Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' 2024-04-25T13:41:50.883 INFO:teuthology.orchestra.run.smithi151.stdout: Process Manager: pmi 2024-04-25T13:41:50.883 INFO:teuthology.orchestra.run.smithi151.stdout: Launchers available: ssh rsh fork slurm ll lsf sge manual persist 2024-04-25T13:41:50.883 INFO:teuthology.orchestra.run.smithi151.stdout: Topology libraries available: hwloc 2024-04-25T13:41:50.883 INFO:teuthology.orchestra.run.smithi151.stdout: Resource management kernels available: user slurm ll lsf sge pbs cobalt 2024-04-25T13:41:50.883 INFO:teuthology.orchestra.run.smithi151.stdout: Demux engines available: poll select 2024-04-25T13:41:50.883 DEBUG:teuthology.orchestra.run.smithi191:> mpiexec --version 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout:HYDRA build details: 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout: Version: 4.0 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout: Release Date: Fri Jan 21 10:42:29 CST 2022 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout: CC: gcc -Wdate-time -D_FORTIFY_SOURCE=2 -g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout: Configure options: '--with-hwloc-prefix=/usr' '--with-device=ch4:ofi' 'FFLAGS=-O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -fallow-invalid-boz -fallow-argument-mismatch' '--prefix=/usr' 'CFLAGS=-g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security' 'LDFLAGS=-Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout: Process Manager: pmi 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout: Launchers available: ssh rsh fork slurm ll lsf sge manual persist 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout: Topology libraries available: hwloc 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout: Resource management kernels available: user slurm ll lsf sge pbs cobalt 2024-04-25T13:41:50.930 INFO:teuthology.orchestra.run.smithi191.stdout: Demux engines available: poll select 2024-04-25T13:41:50.931 INFO:teuthology.task.mpi:MPI version 4.0 2024-04-25T13:41:50.931 INFO:teuthology.task.mpi:mpi rank 0 is: ubuntu@smithi097.front.sepia.ceph.com 2024-04-25T13:41:50.931 INFO:teuthology.task.mpi:mpi nodes: [172.21.15.97, 172.21.15.151, 172.21.15.191] 2024-04-25T13:41:50.931 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:41:50.931 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/mpi-hosts 2024-04-25T13:41:50.936 INFO:teuthology.task.mpi:mpiexec on ubuntu@smithi097.front.sepia.ceph.com: /home/ubuntu/cephtest/binary/usr/local/bin/mdtest -d /home/ubuntu/cephtest/gmnt -I 20 -z 5 -b 2 -R 2024-04-25T13:41:50.937 DEBUG:teuthology.orchestra.run.smithi097:> mpiexec -f /home/ubuntu/cephtest/mpi-hosts /home/ubuntu/cephtest/binary/usr/local/bin/mdtest -d /home/ubuntu/cephtest/gmnt -I 20 -z 5 -b 2 -R 2024-04-25T13:41:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: Permanently added '172.21.15.151' (ED25519) to the list of known hosts. 2024-04-25T13:41:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: Permanently added '172.21.15.191' (ED25519) to the list of known hosts. 2024-04-25T13:41:51.819 INFO:teuthology.orchestra.run.smithi097.stdout:-- started at 04/25/2024 13:41:51 -- 2024-04-25T13:41:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:41:51.819 INFO:teuthology.orchestra.run.smithi097.stdout:mdtest-3.3.0 was launched with 3 total task(s) on 3 node(s) 2024-04-25T13:41:51.820 INFO:teuthology.orchestra.run.smithi097.stdout:Command line used: /home/ubuntu/cephtest/binary/usr/local/bin/mdtest '-d' '/home/ubuntu/cephtest/gmnt' '-I' '20' '-z' '5' '-b' '2' '-R' 2024-04-25T13:41:51.820 INFO:teuthology.orchestra.run.smithi097.stdout:Path: /home/ubuntu/cephtest 2024-04-25T13:41:51.820 INFO:teuthology.orchestra.run.smithi097.stdout:FS: 915.8 GiB Used FS: 1.0% Inodes: 58.2 Mi Used Inodes: 0.3% 2024-04-25T13:41:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:41:51.827 INFO:teuthology.orchestra.run.smithi097.stdout:Nodemap: 100 2024-04-25T13:41:51.827 INFO:teuthology.orchestra.run.smithi097.stdout:random seed: 1714052511 2024-04-25T13:41:51.827 INFO:teuthology.orchestra.run.smithi097.stdout:3 tasks, 3780 files/directories 2024-04-25T13:42:09.538 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:09.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:09.544 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:09.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:09.549 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:39.600 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:39.604 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:39.606 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:39.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:39.611 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:09.666 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:09.669 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:09.672 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:09.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:09.677 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:39.928 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:39.932 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:39.934 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:39.937 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:39.939 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:10.170 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:10.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:10.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:10.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:10.182 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:40.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:40.314 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:40.316 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:40.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:40.322 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:10.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:10.610 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:10.613 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:10.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:10.618 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:40.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:40.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:40.755 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:40.758 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:45:40.761 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:11.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:11.024 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:11.027 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:11.029 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:11.032 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:46:37.223 INFO:teuthology.orchestra.run.smithi097.stdout:SUMMARY rate: (of 1 iterations) 2024-04-25T13:46:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: Operation Max Min Mean Std Dev 2024-04-25T13:46:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: --------- --- --- ---- ------- 2024-04-25T13:46:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: Directory creation : 173.632 173.630 173.631 0.001 2024-04-25T13:46:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: Directory stat : 775.471 775.457 775.462 0.006 2024-04-25T13:46:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: Directory removal : 19.545 19.545 19.545 0.000 2024-04-25T13:46:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: File creation : 140.435 140.434 140.434 0.000 2024-04-25T13:46:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: File stat : 1465.208 1465.157 1465.184 0.021 2024-04-25T13:46:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: File read : 543.640 543.633 543.637 0.003 2024-04-25T13:46:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: File removal : 138.654 138.653 138.653 0.000 2024-04-25T13:46:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: Tree creation : 205.472 205.472 205.472 0.000 2024-04-25T13:46:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: Tree removal : 48.525 48.525 48.525 0.000 2024-04-25T13:46:37.224 INFO:teuthology.orchestra.run.smithi097.stdout:-- finished at 04/25/2024 13:46:37 -- 2024-04-25T13:46:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-25T13:46:37.555 INFO:teuthology.task.mpi:mpi task completed 2024-04-25T13:46:37.555 DEBUG:teuthology.orchestra.run.smithi097:> rm /home/ubuntu/cephtest/mpi-hosts 2024-04-25T13:46:37.561 INFO:teuthology.run_tasks:Running task pexec... 2024-04-25T13:46:37.573 INFO:teuthology.task.pexec:Executing custom commands... 2024-04-25T13:46:37.573 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi097.front.sepia.ceph.com 2024-04-25T13:46:37.574 DEBUG:teuthology.orchestra.run.smithi097:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-25T13:46:37.574 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T13:46:37.574 DEBUG:teuthology.orchestra.run.smithi151:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-25T13:46:37.575 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:46:37.575 DEBUG:teuthology.orchestra.run.smithi191:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-25T13:46:37.629 DEBUG:teuthology.parallel:result is None 2024-04-25T13:46:37.630 DEBUG:teuthology.parallel:result is None 2024-04-25T13:46:37.655 DEBUG:teuthology.parallel:result is None 2024-04-25T13:46:37.655 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2024-04-25T13:46:37.666 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2024-04-25T13:46:37.666 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2024-04-25T13:46:37.666 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi077.front.sepia.ceph.com 2024-04-25T13:46:37.666 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:46:37.672 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:46:37.723 DEBUG:teuthology.orchestra.run.smithi077:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:37.770 INFO:teuthology.orchestra.run.smithi077.stdout:"600" 2024-04-25T13:46:37.770 DEBUG:teuthology.orchestra.run.smithi077:> mv -- /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:49:692778 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:37.818 DEBUG:teuthology.orchestra.run.smithi077:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:37.865 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi096.front.sepia.ceph.com 2024-04-25T13:46:37.866 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:46:37.872 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:46:37.922 DEBUG:teuthology.orchestra.run.smithi096:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:37.968 INFO:teuthology.orchestra.run.smithi096.stdout:"600" 2024-04-25T13:46:37.968 DEBUG:teuthology.orchestra.run.smithi096:> mv -- /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:49:942537 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.016 DEBUG:teuthology.orchestra.run.smithi096:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.063 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi097.front.sepia.ceph.com 2024-04-25T13:46:38.064 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:46:38.069 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:46:38.115 DEBUG:teuthology.orchestra.run.smithi097:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.163 INFO:teuthology.orchestra.run.smithi097.stdout:"600" 2024-04-25T13:46:38.163 DEBUG:teuthology.orchestra.run.smithi097:> mv -- /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:50:193665 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.211 DEBUG:teuthology.orchestra.run.smithi097:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.259 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi151.front.sepia.ceph.com 2024-04-25T13:46:38.259 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:46:38.265 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:46:38.312 DEBUG:teuthology.orchestra.run.smithi151:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.360 INFO:teuthology.orchestra.run.smithi151.stdout:"600" 2024-04-25T13:46:38.361 DEBUG:teuthology.orchestra.run.smithi151:> mv -- /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:50:437715 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.408 DEBUG:teuthology.orchestra.run.smithi151:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.456 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi191.front.sepia.ceph.com 2024-04-25T13:46:38.456 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/.ssh/id_rsa 2024-04-25T13:46:38.462 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-25T13:46:38.510 DEBUG:teuthology.orchestra.run.smithi191:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.558 INFO:teuthology.orchestra.run.smithi191.stdout:"600" 2024-04-25T13:46:38.558 DEBUG:teuthology.orchestra.run.smithi191:> mv -- /home/ubuntu/.ssh/authorized_keys_2024-04-25_13:41:50:684205 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.606 DEBUG:teuthology.orchestra.run.smithi191:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2024-04-25T13:46:38.654 DEBUG:teuthology.orchestra.run.smithi077:> rm /home/ubuntu/.ssh/config 2024-04-25T13:46:38.656 DEBUG:teuthology.orchestra.run.smithi096:> rm /home/ubuntu/.ssh/config 2024-04-25T13:46:38.659 DEBUG:teuthology.orchestra.run.smithi097:> rm /home/ubuntu/.ssh/config 2024-04-25T13:46:38.661 DEBUG:teuthology.orchestra.run.smithi151:> rm /home/ubuntu/.ssh/config 2024-04-25T13:46:38.664 DEBUG:teuthology.orchestra.run.smithi191:> rm /home/ubuntu/.ssh/config 2024-04-25T13:46:38.702 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T13:46:38.712 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T13:46:38.713 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:46:38.713 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:46:38.719 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:46:38.719 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:46:38.767 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:46:38.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3ff0f3f640 1 Processor -- start 2024-04-25T13:46:38.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3ff0f3f640 1 -- start start 2024-04-25T13:46:38.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3ff0f3f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3fec150cb0 0x7f3fec14f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:38.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3ff0f3f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fec14fc60 0x7f3fec0a8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:38.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3ff0f3f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fec1501d0 con 0x7f3fec1540c0 2024-04-25T13:46:38.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3ff0f3f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3fec1504b0 con 0x7f3fec14fc60 2024-04-25T13:46:38.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3ff0f3f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f3fec150790 con 0x7f3fec150cb0 2024-04-25T13:46:38.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3fead9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fec14fc60 0x7f3fec0a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:38.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3fead9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fec14fc60 0x7f3fec0a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55832/0 (socket says 172.21.15.77:55832) 2024-04-25T13:46:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3fead9d640 1 -- 172.21.15.77:0/2476859928 learned_addr learned my addr 172.21.15.77:0/2476859928 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3fe9d9b640 1 --2- 172.21.15.77:0/2476859928 >> v2:172.21.15.96:3300/0 conn(0x7f3fec150cb0 0x7f3fec14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3fead9d640 1 -- 172.21.15.77:0/2476859928 >> v2:172.21.15.96:3300/0 conn(0x7f3fec150cb0 msgr2=0x7f3fec14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3fead9d640 1 --2- 172.21.15.77:0/2476859928 >> v2:172.21.15.96:3300/0 conn(0x7f3fec150cb0 0x7f3fec14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3fead9d640 1 -- 172.21.15.77:0/2476859928 >> v1:172.21.15.96:6789/0 conn(0x7f3fec1540c0 legacy=0x7f3fec06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.926+0000 7f3fead9d640 1 -- 172.21.15.77:0/2476859928 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fec1544d0 con 0x7f3fec14fc60 2024-04-25T13:46:38.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3fead9d640 1 --2- 172.21.15.77:0/2476859928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec14fc60 0x7f3fec0a8180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0a5650 tx=0x7f3fe401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922b1d04d05253ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:38.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3fe959a640 1 -- 172.21.15.77:0/2476859928 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40a55e0 con 0x7f3fec14fc60 2024-04-25T13:46:38.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3fe959a640 1 -- 172.21.15.77:0/2476859928 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe40a5780 con 0x7f3fec14fc60 2024-04-25T13:46:38.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3fe959a640 1 -- 172.21.15.77:0/2476859928 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40a5b50 con 0x7f3fec14fc60 2024-04-25T13:46:38.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2476859928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec14fc60 msgr2=0x7f3fec0a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:38.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3ff0f3f640 1 --2- 172.21.15.77:0/2476859928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec14fc60 0x7f3fec0a8180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0a5650 tx=0x7f3fe401c920 comp rx=0 tx=0).stop 2024-04-25T13:46:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2476859928 shutdown_connections 2024-04-25T13:46:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3ff0f3f640 1 --2- 172.21.15.77:0/2476859928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec14fc60 0x7f3fec0a8180 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3ff0f3f640 1 --2- 172.21.15.77:0/2476859928 >> v2:172.21.15.96:3300/0 conn(0x7f3fec150cb0 0x7f3fec14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2476859928 >> 172.21.15.77:0/2476859928 conn(0x7f3fec0c4ae0 msgr2=0x7f3fec0c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2476859928 shutdown_connections 2024-04-25T13:46:38.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.930+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2476859928 wait complete. 2024-04-25T13:46:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 Processor -- start 2024-04-25T13:46:38.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 -- start start 2024-04-25T13:46:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3fec14fc60 0x7f3fec13d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec150cb0 0x7f3fec13de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1540c0 0x7f3fec13c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec0a9260 con 0x7f3fec1540c0 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec0a90e0 con 0x7f3fec150cb0 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f3fec0a93e0 con 0x7f3fec14fc60 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fead9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1540c0 0x7f3fec13c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fead9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1540c0 0x7f3fec13c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55838/0 (socket says 172.21.15.77:55838) 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fead9d640 1 -- 172.21.15.77:0/2947106879 learned_addr learned my addr 172.21.15.77:0/2947106879 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fe9d9b640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec150cb0 0x7f3fec13de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fea59c640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3fec14fc60 0x7f3fec13d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fead9d640 1 -- 172.21.15.77:0/2947106879 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3fec14fc60 msgr2=0x7f3fec13d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fead9d640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3fec14fc60 0x7f3fec13d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fead9d640 1 -- 172.21.15.77:0/2947106879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec150cb0 msgr2=0x7f3fec13de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fead9d640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec150cb0 0x7f3fec13de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fead9d640 1 -- 172.21.15.77:0/2947106879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fec14c9e0 con 0x7f3fec1540c0 2024-04-25T13:46:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fead9d640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1540c0 0x7f3fec13c1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fe401a550 tx=0x7f3fe40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fdaffd640 1 -- 172.21.15.77:0/2947106879 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40bb020 con 0x7f3fec1540c0 2024-04-25T13:46:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fdaffd640 1 -- 172.21.15.77:0/2947106879 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe40b6890 con 0x7f3fec1540c0 2024-04-25T13:46:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3fdaffd640 1 -- 172.21.15.77:0/2947106879 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40a55e0 con 0x7f3fec1540c0 2024-04-25T13:46:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fec14ccc0 con 0x7f3fec1540c0 2024-04-25T13:46:38.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.934+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fec14a030 con 0x7f3fec1540c0 2024-04-25T13:46:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.938+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fec06a280 con 0x7f3fec1540c0 2024-04-25T13:46:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.938+0000 7f3fdaffd640 1 -- 172.21.15.77:0/2947106879 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3fe40be020 con 0x7f3fec1540c0 2024-04-25T13:46:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.938+0000 7f3fdaffd640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3fcc06f400 0x7f3fcc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.938+0000 7f3fdaffd640 1 -- 172.21.15.77:0/2947106879 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f3fe412a2f0 con 0x7f3fec1540c0 2024-04-25T13:46:38.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.938+0000 7f3fea59c640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3fcc06f400 0x7f3fcc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:38.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.938+0000 7f3fea59c640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3fcc06f400 0x7f3fcc071910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3fec074ce0 tx=0x7f3fdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:38.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:38.942+0000 7f3fdaffd640 1 -- 172.21.15.77:0/2947106879 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3fe40c5030 con 0x7f3fec1540c0 2024-04-25T13:46:39.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.106+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fec1539a0 con 0x7f3fec1540c0 2024-04-25T13:46:39.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.106+0000 7f3fdaffd640 1 -- 172.21.15.77:0/2947106879 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16853 (secure 0 0 0) 0x7f3fe40165a0 con 0x7f3fec1540c0 2024-04-25T13:46:39.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:46:39.107 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:51.564949+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:46:39.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3fcc06f400 msgr2=0x7f3fcc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3fcc06f400 0x7f3fcc071910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3fec074ce0 tx=0x7f3fdc008040 comp rx=0 tx=0).stop 2024-04-25T13:46:39.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1540c0 msgr2=0x7f3fec13c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1540c0 0x7f3fec13c1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fe401a550 tx=0x7f3fe40196c0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 shutdown_connections 2024-04-25T13:46:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3fcc06f400 0x7f3fcc071910 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec1540c0 0x7f3fec13c1a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec150cb0 0x7f3fec13de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 --2- 172.21.15.77:0/2947106879 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3fec14fc60 0x7f3fec13d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 >> 172.21.15.77:0/2947106879 conn(0x7f3fec0c4ae0 msgr2=0x7f3fec0c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 shutdown_connections 2024-04-25T13:46:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.110+0000 7f3ff0f3f640 1 -- 172.21.15.77:0/2947106879 wait complete. 2024-04-25T13:46:39.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:40:58.420007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:41:01.460651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:41:02.746892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:46:39.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:46:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfb5bf2640 1 Processor -- start 2024-04-25T13:46:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfb5bf2640 1 -- start start 2024-04-25T13:46:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfb5bf2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbfb00bf910 0x7fbfb014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfb5bf2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbfb00c0b70 0x7fbfb014f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfb5bf2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb00a4b10 con 0x7fbfb014f760 2024-04-25T13:46:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfb5bf2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb00a50d0 con 0x7fbfb00bf910 2024-04-25T13:46:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfb5bf2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb00a4df0 con 0x7fbfb00c0b70 2024-04-25T13:46:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfaf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbfb00bf910 0x7fbfb014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfaf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbfb00bf910 0x7fbfb014e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55842/0 (socket says 172.21.15.77:55842) 2024-04-25T13:46:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.278+0000 7fbfaf7fe640 1 -- 172.21.15.77:0/1616463740 learned_addr learned my addr 172.21.15.77:0/1616463740 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfaeffd640 1 --2- 172.21.15.77:0/1616463740 >> v2:172.21.15.96:3300/0 conn(0x7fbfb00c0b70 0x7fbfb014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfaf7fe640 1 -- 172.21.15.77:0/1616463740 >> v2:172.21.15.96:3300/0 conn(0x7fbfb00c0b70 msgr2=0x7fbfb014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:39.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfaf7fe640 1 --2- 172.21.15.77:0/1616463740 >> v2:172.21.15.96:3300/0 conn(0x7fbfb00c0b70 0x7fbfb014f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfaf7fe640 1 -- 172.21.15.77:0/1616463740 >> v1:172.21.15.96:6789/0 conn(0x7fbfb014f760 legacy=0x7fbfb0152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:39.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfaf7fe640 1 -- 172.21.15.77:0/1616463740 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb00a2fb0 con 0x7fbfb00bf910 2024-04-25T13:46:39.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfaf7fe640 1 --2- 172.21.15.77:0/1616463740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00bf910 0x7fbfb014e8a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00a6510 tx=0x7fbf9801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66aa94aa7763ea57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:39.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfae7fc640 1 -- 172.21.15.77:0/1616463740 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf980b4070 con 0x7fbfb00bf910 2024-04-25T13:46:39.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfae7fc640 1 -- 172.21.15.77:0/1616463740 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf980a7a00 con 0x7fbfb00bf910 2024-04-25T13:46:39.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfae7fc640 1 -- 172.21.15.77:0/1616463740 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf980a7dd0 con 0x7fbfb00bf910 2024-04-25T13:46:39.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1616463740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00bf910 msgr2=0x7fbfb014e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfb5bf2640 1 --2- 172.21.15.77:0/1616463740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00bf910 0x7fbfb014e8a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00a6510 tx=0x7fbf9801ebb0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1616463740 shutdown_connections 2024-04-25T13:46:39.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfb5bf2640 1 --2- 172.21.15.77:0/1616463740 >> v2:172.21.15.96:3300/0 conn(0x7fbfb00c0b70 0x7fbfb014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfb5bf2640 1 --2- 172.21.15.77:0/1616463740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00bf910 0x7fbfb014e8a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1616463740 >> 172.21.15.77:0/1616463740 conn(0x7fbfb00c3cd0 msgr2=0x7fbfb00c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:39.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1616463740 shutdown_connections 2024-04-25T13:46:39.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.282+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1616463740 wait complete. 2024-04-25T13:46:39.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 Processor -- start 2024-04-25T13:46:39.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 -- start start 2024-04-25T13:46:39.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00bf910 0x7fbfb0149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00c0b70 0x7fbfb01e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb014f760 0x7fbfb01e8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb015b550 con 0x7fbfb00c0b70 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb015b3d0 con 0x7fbfb014f760 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb015b6d0 con 0x7fbfb00bf910 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00c0b70 0x7fbfb01e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00c0b70 0x7fbfb01e7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55854/0 (socket says 172.21.15.77:55854) 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaeffd640 1 -- 172.21.15.77:0/1219937734 learned_addr learned my addr 172.21.15.77:0/1219937734 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaf7fe640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00bf910 0x7fbfb0149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaeffd640 1 -- 172.21.15.77:0/1219937734 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00bf910 msgr2=0x7fbfb0149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaeffd640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00bf910 0x7fbfb0149020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaeffd640 1 -- 172.21.15.77:0/1219937734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb014f760 msgr2=0x7fbfb01e8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaffff640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb014f760 0x7fbfb01e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaeffd640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb014f760 0x7fbfb01e8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaeffd640 1 -- 172.21.15.77:0/1219937734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb01eb910 con 0x7fbfb00c0b70 2024-04-25T13:46:39.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaffff640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb014f760 0x7fbfb01e8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:39.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfaeffd640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00c0b70 0x7fbfb01e7bc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0007e30 tx=0x7fbfa000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:39.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfa7fff640 1 -- 172.21.15.77:0/1219937734 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa001a070 con 0x7fbfb00c0b70 2024-04-25T13:46:39.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfa7fff640 1 -- 172.21.15.77:0/1219937734 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa0003ba0 con 0x7fbfb00c0b70 2024-04-25T13:46:39.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb01ebb50 con 0x7fbfb00c0b70 2024-04-25T13:46:39.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfa7fff640 1 -- 172.21.15.77:0/1219937734 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa000ee30 con 0x7fbfb00c0b70 2024-04-25T13:46:39.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.286+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb0073660 con 0x7fbfb00c0b70 2024-04-25T13:46:39.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.290+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb006a1a0 con 0x7fbfb00c0b70 2024-04-25T13:46:39.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.290+0000 7fbfa7fff640 1 -- 172.21.15.77:0/1219937734 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbfa001d070 con 0x7fbfb00c0b70 2024-04-25T13:46:39.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.290+0000 7fbfa7fff640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbf9006f430 0x7fbf90071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.290+0000 7fbfaf7fe640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbf9006f430 0x7fbf90071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.290+0000 7fbfa7fff640 1 -- 172.21.15.77:0/1219937734 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fbfa008f380 con 0x7fbfb00c0b70 2024-04-25T13:46:39.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.290+0000 7fbfaf7fe640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbf9006f430 0x7fbf90071940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf980b1000 tx=0x7fbf980a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:39.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.294+0000 7fbfa7fff640 1 -- 172.21.15.77:0/1219937734 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbfa005bc20 con 0x7fbfb00c0b70 2024-04-25T13:46:39.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbfb00c1fe0 con 0x7fbfb00c0b70 2024-04-25T13:46:39.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfa7fff640 1 -- 172.21.15.77:0/1219937734 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fbfa005ff20 con 0x7fbfb00c0b70 2024-04-25T13:46:39.458 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T13:46:39.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbf9006f430 msgr2=0x7fbf90071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbf9006f430 0x7fbf90071940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf980b1000 tx=0x7fbf980a9070 comp rx=0 tx=0).stop 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00c0b70 msgr2=0x7fbfb01e7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00c0b70 0x7fbfb01e7bc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0007e30 tx=0x7fbfa000e4b0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 shutdown_connections 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbf9006f430 0x7fbf90071940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfb014f760 0x7fbfb01e8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfb00c0b70 0x7fbfb01e7bc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 --2- 172.21.15.77:0/1219937734 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfb00bf910 0x7fbfb0149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 >> 172.21.15.77:0/1219937734 conn(0x7fbfb00c3cd0 msgr2=0x7fbfb00a6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 shutdown_connections 2024-04-25T13:46:39.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.458+0000 7fbfb5bf2640 1 -- 172.21.15.77:0/1219937734 wait complete. 2024-04-25T13:46:39.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:46:39.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fc2c0640 1 Processor -- start 2024-04-25T13:46:39.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fc2c0640 1 -- start start 2024-04-25T13:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fc2c0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0f40c3780 0x7fb0f4154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fc2c0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb0f414f580 0x7fb0f414f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fc2c0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f41545a0 con 0x7fb0f40c1440 2024-04-25T13:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fc2c0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb0f40c0eb0 con 0x7fb0f40c3780 2024-04-25T13:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fc2c0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb0f4153860 con 0x7fb0f414f580 2024-04-25T13:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fa05c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0f40c3780 0x7fb0f4154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fa05c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0f40c3780 0x7fb0f4154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55866/0 (socket says 172.21.15.77:55866) 2024-04-25T13:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fa05c640 1 -- 172.21.15.77:0/3269640211 learned_addr learned my addr 172.21.15.77:0/3269640211 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fa85d640 1 --2- 172.21.15.77:0/3269640211 >> v2:172.21.15.96:3300/0 conn(0x7fb0f414f580 0x7fb0f414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fa05c640 1 -- 172.21.15.77:0/3269640211 >> v2:172.21.15.96:3300/0 conn(0x7fb0f414f580 msgr2=0x7fb0f414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fa05c640 1 --2- 172.21.15.77:0/3269640211 >> v2:172.21.15.96:3300/0 conn(0x7fb0f414f580 0x7fb0f414f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fa05c640 1 -- 172.21.15.77:0/3269640211 >> v1:172.21.15.96:6789/0 conn(0x7fb0f40c1440 legacy=0x7fb0f40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.638+0000 7fb0fa05c640 1 -- 172.21.15.77:0/3269640211 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f4153b40 con 0x7fb0f40c3780 2024-04-25T13:46:39.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0fa05c640 1 --2- 172.21.15.77:0/3269640211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 0x7fb0f4154060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0f406fab0 tx=0x7fb0f001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652718ffbf19a85b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:39.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0f905a640 1 -- 172.21.15.77:0/3269640211 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00a7070 con 0x7fb0f40c3780 2024-04-25T13:46:39.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0f905a640 1 -- 172.21.15.77:0/3269640211 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f00b0070 con 0x7fb0f40c3780 2024-04-25T13:46:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0f905a640 1 -- 172.21.15.77:0/3269640211 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00ab890 con 0x7fb0f40c3780 2024-04-25T13:46:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3269640211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 msgr2=0x7fb0f4154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0fc2c0640 1 --2- 172.21.15.77:0/3269640211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 0x7fb0f4154060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0f406fab0 tx=0x7fb0f001c450 comp rx=0 tx=0).stop 2024-04-25T13:46:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3269640211 shutdown_connections 2024-04-25T13:46:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0fc2c0640 1 --2- 172.21.15.77:0/3269640211 >> v2:172.21.15.96:3300/0 conn(0x7fb0f414f580 0x7fb0f414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0fc2c0640 1 --2- 172.21.15.77:0/3269640211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 0x7fb0f4154060 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3269640211 >> 172.21.15.77:0/3269640211 conn(0x7fb0f40a66f0 msgr2=0x7fb0f40a6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3269640211 shutdown_connections 2024-04-25T13:46:39.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.642+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3269640211 wait complete. 2024-04-25T13:46:39.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 Processor -- start 2024-04-25T13:46:39.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 -- start start 2024-04-25T13:46:39.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f40c1440 0x7fb0f40a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 0x7fb0f41eca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f414f580 0x7fb0f41ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f40c19d0 con 0x7fb0f40c3780 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f40c1850 con 0x7fb0f414f580 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f415d210 con 0x7fb0f40c1440 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0f985b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 0x7fb0f41eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0f985b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 0x7fb0f41eca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55868/0 (socket says 172.21.15.77:55868) 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0f985b640 1 -- 172.21.15.77:0/3876753817 learned_addr learned my addr 172.21.15.77:0/3876753817 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fa85d640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f414f580 0x7fb0f41ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fa05c640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f40c1440 0x7fb0f40a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0f985b640 1 -- 172.21.15.77:0/3876753817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f40c1440 msgr2=0x7fb0f40a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0f985b640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f40c1440 0x7fb0f40a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0f985b640 1 -- 172.21.15.77:0/3876753817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f414f580 msgr2=0x7fb0f41ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0f985b640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f414f580 0x7fb0f41ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0f985b640 1 -- 172.21.15.77:0/3876753817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f414e030 con 0x7fb0f40c3780 2024-04-25T13:46:39.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0f985b640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 0x7fb0f41eca60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400b3c0 tx=0x7fb0e400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:39.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0eaffd640 1 -- 172.21.15.77:0/3876753817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4011830 con 0x7fb0f40c3780 2024-04-25T13:46:39.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0eaffd640 1 -- 172.21.15.77:0/3876753817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e4016070 con 0x7fb0f40c3780 2024-04-25T13:46:39.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0eaffd640 1 -- 172.21.15.77:0/3876753817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4011c30 con 0x7fb0f40c3780 2024-04-25T13:46:39.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f414e310 con 0x7fb0f40c3780 2024-04-25T13:46:39.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.646+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f40a6030 con 0x7fb0f40c3780 2024-04-25T13:46:39.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.650+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f406a1a0 con 0x7fb0f40c3780 2024-04-25T13:46:39.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.650+0000 7fb0eaffd640 1 -- 172.21.15.77:0/3876753817 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb0e401b460 con 0x7fb0f40c3780 2024-04-25T13:46:39.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.650+0000 7fb0eaffd640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb0d806f400 0x7fb0d8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.650+0000 7fb0fa05c640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb0d806f400 0x7fb0d8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.650+0000 7fb0eaffd640 1 -- 172.21.15.77:0/3876753817 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fb0e408ee10 con 0x7fb0f40c3780 2024-04-25T13:46:39.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.650+0000 7fb0fa05c640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb0d806f400 0x7fb0d8071910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00af000 tx=0x7fb0f00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:39.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.654+0000 7fb0eaffd640 1 -- 172.21.15.77:0/3876753817 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb0e4020020 con 0x7fb0f40c3780 2024-04-25T13:46:39.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.814+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb0f4149670 con 0x7fb0f40c3780 2024-04-25T13:46:39.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.814+0000 7fb0eaffd640 1 -- 172.21.15.77:0/3876753817 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fb0e405bc70 con 0x7fb0f40c3780 2024-04-25T13:46:39.816 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T13:46:39.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb0d806f400 msgr2=0x7fb0d8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb0d806f400 0x7fb0d8071910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00af000 tx=0x7fb0f00a7000 comp rx=0 tx=0).stop 2024-04-25T13:46:39.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 msgr2=0x7fb0f41eca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 0x7fb0f41eca60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400b3c0 tx=0x7fb0e400b880 comp rx=0 tx=0).stop 2024-04-25T13:46:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 shutdown_connections 2024-04-25T13:46:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb0d806f400 0x7fb0d8071910 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00af000 tx=0x7fb0f00a7000 comp rx=0 tx=0).stop 2024-04-25T13:46:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f414f580 0x7fb0f41ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f40c3780 0x7fb0f41eca60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 --2- 172.21.15.77:0/3876753817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f40c1440 0x7fb0f40a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 >> 172.21.15.77:0/3876753817 conn(0x7fb0f40a66f0 msgr2=0x7fb0f41487a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 shutdown_connections 2024-04-25T13:46:39.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.818+0000 7fb0fc2c0640 1 -- 172.21.15.77:0/3876753817 wait complete. 2024-04-25T13:46:39.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:46:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75f09a5640 1 Processor -- start 2024-04-25T13:46:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75f09a5640 1 -- start start 2024-04-25T13:46:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75f09a5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec14fe10 0x7f75ec072e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75f09a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ec0741b0 con 0x7f75ec06fba0 2024-04-25T13:46:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75f09a5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ec071b10 con 0x7f75ec0733d0 2024-04-25T13:46:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75f09a5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0bfe40 con 0x7f75ec14fe10 2024-04-25T13:46:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75ea59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f75ec06fba0 0x7f75ec14f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35812/0 (socket says 172.21.15.77:35812) 2024-04-25T13:46:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75ea59c640 1 -- 172.21.15.77:0/3268712127 learned_addr learned my addr 172.21.15.77:0/3268712127 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e3fff640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec14fe10 0x7f75ec072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350098778 0 0) 0x7f75ec0741b0 con 0x7f75ec06fba0 2024-04-25T13:46:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75d8003530 con 0x7f75ec06fba0 2024-04-25T13:46:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3648375892 0 0) 0x7f75d8003530 con 0x7f75ec06fba0 2024-04-25T13:46:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec14fe10 msgr2=0x7f75ec072e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec14fe10 0x7f75ec072e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 >> v1:172.21.15.96:6789/0 conn(0x7f75ec0733d0 legacy=0x7f75ec0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec06ffb0 con 0x7f75ec06fba0 2024-04-25T13:46:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f75dc001680 con 0x7f75ec06fba0 2024-04-25T13:46:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 >> v1:172.21.15.77:6789/0 conn(0x7f75ec06fba0 legacy=0x7f75ec14f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8003a60 0x7f75d8003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75d8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec14fe10 0x7f75d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec0bfe40 con 0x7f75d8004810 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8005510 con 0x7f75d8003a60 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f75d800bf10 con 0x7f75ec14fe10 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e3fff640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75d8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75ea59c640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8003a60 0x7f75d8003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75ead9d640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec14fe10 0x7f75d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e3fff640 1 -- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec14fe10 msgr2=0x7f75d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e3fff640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec14fe10 0x7f75d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e3fff640 1 -- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8003a60 msgr2=0x7f75d8003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e3fff640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8003a60 0x7f75d8003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75e3fff640 1 -- 172.21.15.77:0/3268712127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d8003530 con 0x7f75d8004810 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75ead9d640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec14fe10 0x7f75d800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.986+0000 7f75ea59c640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8003a60 0x7f75d8003ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75e3fff640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75d8004c20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0c0180 tx=0x7f75d401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec15a1815026c09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d40b2070 con 0x7f75d8004810 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d40a5510 con 0x7f75d8004810 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75e9d9b640 1 -- 172.21.15.77:0/3268712127 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d40096b0 con 0x7f75d8004810 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75f09a5640 1 -- 172.21.15.77:0/3268712127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 msgr2=0x7f75d8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75f09a5640 1 --2- 172.21.15.77:0/3268712127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75d8004c20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0c0180 tx=0x7f75d401ca30 comp rx=0 tx=0).stop 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75ead9d640 1 -- 172.21.15.77:0/3268712127 reap_dead start 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75f09a5640 1 -- 172.21.15.77:0/3268712127 shutdown_connections 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75f09a5640 1 -- 172.21.15.77:0/3268712127 >> 172.21.15.77:0/3268712127 conn(0x7f75ec0c3cd0 msgr2=0x7f75ec0c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75f09a5640 1 -- 172.21.15.77:0/3268712127 shutdown_connections 2024-04-25T13:46:39.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.990+0000 7f75f09a5640 1 -- 172.21.15.77:0/3268712127 wait complete. 2024-04-25T13:46:39.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 Processor -- start 2024-04-25T13:46:39.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 -- start start 2024-04-25T13:46:39.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75ec145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75ec146a90 0x7f75ec1eef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec0a4ea0 0x7f75ec143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec15c630 con 0x7f75d8004810 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec0a8cc0 con 0x7f75ec146a90 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec15c7b0 con 0x7f75ec0a4ea0 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ea59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75ec145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ea59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75ec145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55884/0 (socket says 172.21.15.77:55884) 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ea59c640 1 -- 172.21.15.77:0/1707168356 learned_addr learned my addr 172.21.15.77:0/1707168356 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ead9d640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec0a4ea0 0x7f75ec143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ea59c640 1 -- 172.21.15.77:0/1707168356 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec0a4ea0 msgr2=0x7f75ec143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ea59c640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec0a4ea0 0x7f75ec143980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75e3fff640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75ec146a90 0x7f75ec1eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ea59c640 1 -- 172.21.15.77:0/1707168356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75ec146a90 msgr2=0x7f75ec1eef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ea59c640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75ec146a90 0x7f75ec1eef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ea59c640 1 -- 172.21.15.77:0/1707168356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0c2350 con 0x7f75d8004810 2024-04-25T13:46:39.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75ea59c640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75ec145b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00e940 tx=0x7f75dc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:39.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75e2ffd640 1 -- 172.21.15.77:0/1707168356 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc019070 con 0x7f75d8004810 2024-04-25T13:46:39.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75e2ffd640 1 -- 172.21.15.77:0/1707168356 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75dc004ac0 con 0x7f75d8004810 2024-04-25T13:46:39.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec0c2aa0 con 0x7f75d8004810 2024-04-25T13:46:39.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75e2ffd640 1 -- 172.21.15.77:0/1707168356 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc005050 con 0x7f75d8004810 2024-04-25T13:46:39.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec0a3710 con 0x7f75d8004810 2024-04-25T13:46:39.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.994+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec06a1a0 con 0x7f75d8004810 2024-04-25T13:46:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.998+0000 7f75e2ffd640 1 -- 172.21.15.77:0/1707168356 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f75dc01c070 con 0x7f75d8004810 2024-04-25T13:46:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.998+0000 7f75e2ffd640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f75cc06f400 0x7f75cc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.998+0000 7f75e2ffd640 1 -- 172.21.15.77:0/1707168356 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f75dc08ec80 con 0x7f75d8004810 2024-04-25T13:46:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.998+0000 7f75e3fff640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f75cc06f400 0x7f75cc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:39.998+0000 7f75e3fff640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f75cc06f400 0x7f75cc071910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75d40af000 tx=0x7f75d40046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:40.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.002+0000 7f75e2ffd640 1 -- 172.21.15.77:0/1707168356 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f75dc05b490 con 0x7f75d8004810 2024-04-25T13:46:40.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.150+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f75ec0c2d10 con 0x7f75d8004810 2024-04-25T13:46:40.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.150+0000 7f75e2ffd640 1 -- 172.21.15.77:0/1707168356 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f75dc05f790 con 0x7f75d8004810 2024-04-25T13:46:40.150 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T13:46:40.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.150+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f75cc06f400 msgr2=0x7f75cc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.150+0000 7f75f09a5640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f75cc06f400 0x7f75cc071910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75d40af000 tx=0x7f75d40046d0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.150+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 msgr2=0x7f75ec145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.150+0000 7f75f09a5640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75ec145b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00e940 tx=0x7f75dc00ee00 comp rx=0 tx=0).stop 2024-04-25T13:46:40.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.150+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 shutdown_connections 2024-04-25T13:46:40.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.150+0000 7f75f09a5640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f75cc06f400 0x7f75cc071910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.150+0000 7f75f09a5640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f75ec0a4ea0 0x7f75ec143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.154+0000 7f75f09a5640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75ec146a90 0x7f75ec1eef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.154+0000 7f75f09a5640 1 --2- 172.21.15.77:0/1707168356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75d8004810 0x7f75ec145b30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.154+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 >> 172.21.15.77:0/1707168356 conn(0x7f75ec0c3cd0 msgr2=0x7f75ec0c15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:40.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.154+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 shutdown_connections 2024-04-25T13:46:40.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.154+0000 7f75f09a5640 1 -- 172.21.15.77:0/1707168356 wait complete. 2024-04-25T13:46:40.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:46:40.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8b13fe640 1 Processor -- start 2024-04-25T13:46:40.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8b13fe640 1 -- start start 2024-04-25T13:46:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8b13fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8ac06fba0 0x7fe8ac14f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8b13fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac14fc40 0x7fe8ac153870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8b13fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe8ac153db0 0x7fe8ac1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8b13fe640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ac154700 con 0x7fe8ac06fba0 2024-04-25T13:46:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8b13fe640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ac0741b0 con 0x7fe8ac153db0 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8b13fe640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac071b10 con 0x7fe8ac14fc40 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8aaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8ac06fba0 0x7fe8ac14f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8aaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8ac06fba0 0x7fe8ac14f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37560/0 (socket says 172.21.15.77:37560) 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8aaffd640 1 -- 172.21.15.77:0/4249437351 learned_addr learned my addr 172.21.15.77:0/4249437351 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8aa7fc640 1 --2- 172.21.15.77:0/4249437351 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac14fc40 0x7fe8ac153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8ab7fe640 1 --2- 172.21.15.77:0/4249437351 >> v2:172.21.15.96:3300/0 conn(0x7fe8ac153db0 0x7fe8ac1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8aaffd640 1 -- 172.21.15.77:0/4249437351 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac14fc40 msgr2=0x7fe8ac153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8aaffd640 1 --2- 172.21.15.77:0/4249437351 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac14fc40 0x7fe8ac153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8aaffd640 1 -- 172.21.15.77:0/4249437351 >> v2:172.21.15.96:3300/0 conn(0x7fe8ac153db0 msgr2=0x7fe8ac1541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8aaffd640 1 --2- 172.21.15.77:0/4249437351 >> v2:172.21.15.96:3300/0 conn(0x7fe8ac153db0 0x7fe8ac1541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8aaffd640 1 -- 172.21.15.77:0/4249437351 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac0bfe40 con 0x7fe8ac06fba0 2024-04-25T13:46:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.306+0000 7fe8ab7fe640 1 --2- 172.21.15.77:0/4249437351 >> v2:172.21.15.96:3300/0 conn(0x7fe8ac153db0 0x7fe8ac1541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:40.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8aaffd640 1 --2- 172.21.15.77:0/4249437351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 0x7fe8ac14f700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac072d60 tx=0x7fe89c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cc746f44b21e6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:40.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8a9ffb640 1 -- 172.21.15.77:0/4249437351 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0b2070 con 0x7fe8ac06fba0 2024-04-25T13:46:40.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8a9ffb640 1 -- 172.21.15.77:0/4249437351 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89c0a9070 con 0x7fe8ac06fba0 2024-04-25T13:46:40.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8a9ffb640 1 -- 172.21.15.77:0/4249437351 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0ad880 con 0x7fe8ac06fba0 2024-04-25T13:46:40.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8b13fe640 1 -- 172.21.15.77:0/4249437351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 msgr2=0x7fe8ac14f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/4249437351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 0x7fe8ac14f700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac072d60 tx=0x7fe89c01c490 comp rx=0 tx=0).stop 2024-04-25T13:46:40.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8b13fe640 1 -- 172.21.15.77:0/4249437351 shutdown_connections 2024-04-25T13:46:40.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/4249437351 >> v2:172.21.15.96:3300/0 conn(0x7fe8ac153db0 0x7fe8ac1541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/4249437351 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac14fc40 0x7fe8ac153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/4249437351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 0x7fe8ac14f700 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8b13fe640 1 -- 172.21.15.77:0/4249437351 >> 172.21.15.77:0/4249437351 conn(0x7fe8ac0c3cd0 msgr2=0x7fe8ac0c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:40.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8b13fe640 1 -- 172.21.15.77:0/4249437351 shutdown_connections 2024-04-25T13:46:40.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.310+0000 7fe8b13fe640 1 -- 172.21.15.77:0/4249437351 wait complete. 2024-04-25T13:46:40.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 Processor -- start 2024-04-25T13:46:40.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 -- start start 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 0x7fe8ac14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac14fc40 0x7fe8ac151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac153db0 0x7fe8ac143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac0736a0 con 0x7fe8ac06fba0 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac0a8cc0 con 0x7fe8ac14fc40 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac073820 con 0x7fe8ac153db0 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 0x7fe8ac14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 0x7fe8ac14e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37570/0 (socket says 172.21.15.77:37570) 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aaffd640 1 -- 172.21.15.77:0/989402088 learned_addr learned my addr 172.21.15.77:0/989402088 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8ab7fe640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac153db0 0x7fe8ac143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aaffd640 1 -- 172.21.15.77:0/989402088 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac153db0 msgr2=0x7fe8ac143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aaffd640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac153db0 0x7fe8ac143a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aa7fc640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac14fc40 0x7fe8ac151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aaffd640 1 -- 172.21.15.77:0/989402088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac14fc40 msgr2=0x7fe8ac151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aaffd640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac14fc40 0x7fe8ac151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aaffd640 1 -- 172.21.15.77:0/989402088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac153a40 con 0x7fe8ac06fba0 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8aaffd640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 0x7fe8ac14e7c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0b0040 tx=0x7fe89c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8937fe640 1 -- 172.21.15.77:0/989402088 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0b2040 con 0x7fe8ac06fba0 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8937fe640 1 -- 172.21.15.77:0/989402088 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89c0bb070 con 0x7fe8ac06fba0 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8937fe640 1 -- 172.21.15.77:0/989402088 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0b6440 con 0x7fe8ac06fba0 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ac144e70 con 0x7fe8ac06fba0 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.314+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ac1521d0 con 0x7fe8ac06fba0 2024-04-25T13:46:40.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.318+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ac06a1a0 con 0x7fe8ac06fba0 2024-04-25T13:46:40.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.318+0000 7fe8937fe640 1 -- 172.21.15.77:0/989402088 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe89c0ab070 con 0x7fe8ac06fba0 2024-04-25T13:46:40.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.318+0000 7fe8937fe640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe89806f430 0x7fe898071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.318+0000 7fe8937fe640 1 -- 172.21.15.77:0/989402088 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe89c1297c0 con 0x7fe8ac06fba0 2024-04-25T13:46:40.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.318+0000 7fe8aa7fc640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe89806f430 0x7fe898071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.318+0000 7fe8aa7fc640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe89806f430 0x7fe898071940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac154ce0 tx=0x7fe8a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.322+0000 7fe8937fe640 1 -- 172.21.15.77:0/989402088 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe8ac144e70 con 0x7fe8ac06fba0 2024-04-25T13:46:40.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.486+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe8ac148070 con 0x7fe8ac06fba0 2024-04-25T13:46:40.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.486+0000 7fe8937fe640 1 -- 172.21.15.77:0/989402088 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fe89c016110 con 0x7fe8ac06fba0 2024-04-25T13:46:40.488 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-04-25T13:46:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe89806f430 msgr2=0x7fe898071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe89806f430 0x7fe898071940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac154ce0 tx=0x7fe8a0008040 comp rx=0 tx=0).stop 2024-04-25T13:46:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 msgr2=0x7fe8ac14e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 0x7fe8ac14e7c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0b0040 tx=0x7fe89c019230 comp rx=0 tx=0).stop 2024-04-25T13:46:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 shutdown_connections 2024-04-25T13:46:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe89806f430 0x7fe898071940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe8ac153db0 0x7fe8ac143a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8ac14fc40 0x7fe8ac151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 --2- 172.21.15.77:0/989402088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8ac06fba0 0x7fe8ac14e7c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 >> 172.21.15.77:0/989402088 conn(0x7fe8ac0c3cd0 msgr2=0x7fe8ac0c2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 shutdown_connections 2024-04-25T13:46:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.490+0000 7fe8b13fe640 1 -- 172.21.15.77:0/989402088 wait complete. 2024-04-25T13:46:40.509 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-25T13:46:40.509 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:46:40.515 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:46:40.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12ad4dc640 1 Processor -- start 2024-04-25T13:46:40.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12ad4dc640 1 -- start start 2024-04-25T13:46:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12ad4dc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f12a80736e0 0x7f12a81538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12ad4dc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a8073e40 con 0x7f12a80727c0 2024-04-25T13:46:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12ad4dc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a8153de0 con 0x7f12a814fbd0 2024-04-25T13:46:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12ad4dc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f12a8074120 con 0x7f12a80736e0 2024-04-25T13:46:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12a6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f12a80736e0 0x7f12a81538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12a77fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f12a80727c0 0x7f12a815ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56484/0 (socket says 172.21.15.77:56484) 2024-04-25T13:46:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12a77fe640 1 -- 172.21.15.77:0/1565971043 learned_addr learned my addr 172.21.15.77:0/1565971043 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12a6ffd640 1 -- 172.21.15.77:0/1565971043 >> v1:172.21.15.96:6789/0 conn(0x7f12a814fbd0 legacy=0x7f12a8070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12a6ffd640 1 -- 172.21.15.77:0/1565971043 >> v1:172.21.15.77:6789/0 conn(0x7f12a80727c0 legacy=0x7f12a815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.662+0000 7f12a6ffd640 1 -- 172.21.15.77:0/1565971043 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a8070c20 con 0x7f12a80736e0 2024-04-25T13:46:40.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12a6ffd640 1 --2- 172.21.15.77:0/1565971043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a80736e0 0x7f12a81538a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f12a00097c0 tx=0x7f12a001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e920de5b35527e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:40.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12a5ffb640 1 -- 172.21.15.77:0/1565971043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a00b0070 con 0x7f12a80736e0 2024-04-25T13:46:40.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12a5ffb640 1 -- 172.21.15.77:0/1565971043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a00ab600 con 0x7f12a80736e0 2024-04-25T13:46:40.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12a5ffb640 1 -- 172.21.15.77:0/1565971043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a00ab9d0 con 0x7f12a80736e0 2024-04-25T13:46:40.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1565971043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a80736e0 msgr2=0x7f12a81538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12ad4dc640 1 --2- 172.21.15.77:0/1565971043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a80736e0 0x7f12a81538a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f12a00097c0 tx=0x7f12a001c340 comp rx=0 tx=0).stop 2024-04-25T13:46:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1565971043 shutdown_connections 2024-04-25T13:46:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12ad4dc640 1 --2- 172.21.15.77:0/1565971043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a80736e0 0x7f12a81538a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1565971043 >> 172.21.15.77:0/1565971043 conn(0x7f12a806c9e0 msgr2=0x7f12a806ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1565971043 shutdown_connections 2024-04-25T13:46:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.666+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1565971043 wait complete. 2024-04-25T13:46:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 Processor -- start 2024-04-25T13:46:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 -- start start 2024-04-25T13:46:40.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12a80727c0 0x7f12a80b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12a80736e0 0x7f12a814da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a814fbd0 0x7f12a814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f12a815ecf0 con 0x7f12a814fbd0 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f12a815eb70 con 0x7f12a80727c0 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f12a815ee70 con 0x7f12a80736e0 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a814fbd0 0x7f12a814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a814fbd0 0x7f12a814dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37598/0 (socket says 172.21.15.77:37598) 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a77fe640 1 -- 172.21.15.77:0/1441472728 learned_addr learned my addr 172.21.15.77:0/1441472728 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a6ffd640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12a80727c0 0x7f12a80b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a67fc640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12a80736e0 0x7f12a814da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a77fe640 1 -- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12a80736e0 msgr2=0x7f12a814da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a77fe640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12a80736e0 0x7f12a814da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a77fe640 1 -- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12a80727c0 msgr2=0x7f12a80b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a77fe640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12a80727c0 0x7f12a80b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a77fe640 1 -- 172.21.15.77:0/1441472728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a8146630 con 0x7f12a814fbd0 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a6ffd640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12a80727c0 0x7f12a80b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a67fc640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12a80736e0 0x7f12a814da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12a77fe640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a814fbd0 0x7f12a814dfc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f129800cad0 tx=0x7f129800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f128f7fe640 1 -- 172.21.15.77:0/1441472728 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298017070 con 0x7f12a814fbd0 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f128f7fe640 1 -- 172.21.15.77:0/1441472728 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129800ab70 con 0x7f12a814fbd0 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a81ef9c0 con 0x7f12a814fbd0 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f128f7fe640 1 -- 172.21.15.77:0/1441472728 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298012400 con 0x7f12a814fbd0 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a814e7f0 con 0x7f12a814fbd0 2024-04-25T13:46:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.670+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a814ea50 con 0x7f12a814fbd0 2024-04-25T13:46:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.674+0000 7f128f7fe640 1 -- 172.21.15.77:0/1441472728 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f129801a070 con 0x7f12a814fbd0 2024-04-25T13:46:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.674+0000 7f128f7fe640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f129406f400 0x7f1294071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.674+0000 7f128f7fe640 1 -- 172.21.15.77:0/1441472728 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f129808eed0 con 0x7f12a814fbd0 2024-04-25T13:46:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.674+0000 7f12a6ffd640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f129406f400 0x7f1294071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.674+0000 7f12a6ffd640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f129406f400 0x7f1294071910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12a00ad000 tx=0x7f12a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.678+0000 7f128f7fe640 1 -- 172.21.15.77:0/1441472728 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f129805bdc0 con 0x7f12a814fbd0 2024-04-25T13:46:40.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.838+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12a8146800 con 0x7f12a814fbd0 2024-04-25T13:46:40.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.842+0000 7f128f7fe640 1 -- 172.21.15.77:0/1441472728 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16853 (secure 0 0 0) 0x7f12a8146800 con 0x7f12a814fbd0 2024-04-25T13:46:40.844 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:46:40.844 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:51.564949+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f129406f400 msgr2=0x7f1294071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f129406f400 0x7f1294071910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12a00ad000 tx=0x7f12a0008040 comp rx=0 tx=0).stop 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a814fbd0 msgr2=0x7f12a814dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a814fbd0 0x7f12a814dfc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f129800cad0 tx=0x7f129800cf90 comp rx=0 tx=0).stop 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 shutdown_connections 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f129406f400 0x7f1294071910 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a814fbd0 0x7f12a814dfc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12a80736e0 0x7f12a814da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 --2- 172.21.15.77:0/1441472728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12a80727c0 0x7f12a80b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 >> 172.21.15.77:0/1441472728 conn(0x7f12a806c9e0 msgr2=0x7f12a814c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:40.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 shutdown_connections 2024-04-25T13:46:40.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:40.846+0000 7f12ad4dc640 1 -- 172.21.15.77:0/1441472728 wait complete. 2024-04-25T13:46:40.865 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:40:58.420007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:41:01.460651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:41:02.746892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:46:40.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:46:41.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b1710e640 1 Processor -- start 2024-04-25T13:46:41.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b1710e640 1 -- start start 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b1710e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10074860 0x7f4b100a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b1710e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4b1006d6c0 0x7f4b1006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b1710e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b10151e50 0x7f4b100739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b1710e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4b100a7260 con 0x7f4b10151e50 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b1710e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4b1006ef60 con 0x7f4b1006d6c0 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b1710e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f4b100a8ab0 con 0x7f4b10074860 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b156ab640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b10151e50 0x7f4b100739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b156ab640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b10151e50 0x7f4b100739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37604/0 (socket says 172.21.15.77:37604) 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b156ab640 1 -- 172.21.15.77:0/3812605514 learned_addr learned my addr 172.21.15.77:0/3812605514 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b14eaa640 1 --2- 172.21.15.77:0/3812605514 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10074860 0x7f4b100a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b0ffff640 1 --2- 172.21.15.77:0/3812605514 >> v2:172.21.15.96:3300/0 conn(0x7f4b1006d6c0 0x7f4b1006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b156ab640 1 -- 172.21.15.77:0/3812605514 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10074860 msgr2=0x7f4b100a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:41.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b156ab640 1 --2- 172.21.15.77:0/3812605514 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10074860 0x7f4b100a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b156ab640 1 -- 172.21.15.77:0/3812605514 >> v2:172.21.15.96:3300/0 conn(0x7f4b1006d6c0 msgr2=0x7f4b1006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:41.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b156ab640 1 --2- 172.21.15.77:0/3812605514 >> v2:172.21.15.96:3300/0 conn(0x7f4b1006d6c0 0x7f4b1006ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b156ab640 1 -- 172.21.15.77:0/3812605514 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b100aaf00 con 0x7f4b10151e50 2024-04-25T13:46:41.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.006+0000 7f4b14eaa640 1 --2- 172.21.15.77:0/3812605514 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10074860 0x7f4b100a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:41.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b156ab640 1 --2- 172.21.15.77:0/3812605514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10151e50 0x7f4b100739d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b10071f10 tx=0x7f4b0001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d53f55510d01b5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b0f7fe640 1 -- 172.21.15.77:0/3812605514 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000b0070 con 0x7f4b10151e50 2024-04-25T13:46:41.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b0f7fe640 1 -- 172.21.15.77:0/3812605514 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b000ab600 con 0x7f4b10151e50 2024-04-25T13:46:41.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b0f7fe640 1 -- 172.21.15.77:0/3812605514 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000ab9d0 con 0x7f4b10151e50 2024-04-25T13:46:41.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b1710e640 1 -- 172.21.15.77:0/3812605514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10151e50 msgr2=0x7f4b100739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b1710e640 1 --2- 172.21.15.77:0/3812605514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10151e50 0x7f4b100739d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b10071f10 tx=0x7f4b0001c490 comp rx=0 tx=0).stop 2024-04-25T13:46:41.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b1710e640 1 -- 172.21.15.77:0/3812605514 shutdown_connections 2024-04-25T13:46:41.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b1710e640 1 --2- 172.21.15.77:0/3812605514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10151e50 0x7f4b100739d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b1710e640 1 --2- 172.21.15.77:0/3812605514 >> v2:172.21.15.96:3300/0 conn(0x7f4b1006d6c0 0x7f4b1006ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b1710e640 1 --2- 172.21.15.77:0/3812605514 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10074860 0x7f4b100a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b1710e640 1 -- 172.21.15.77:0/3812605514 >> 172.21.15.77:0/3812605514 conn(0x7f4b100a7d80 msgr2=0x7f4b100c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:41.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b1710e640 1 -- 172.21.15.77:0/3812605514 shutdown_connections 2024-04-25T13:46:41.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.010+0000 7f4b1710e640 1 -- 172.21.15.77:0/3812605514 wait complete. 2024-04-25T13:46:41.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 Processor -- start 2024-04-25T13:46:41.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 -- start start 2024-04-25T13:46:41.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1006d6c0 0x7f4b1014c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10074860 0x7f4b10151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10151e50 0x7f4b101eefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4b100719b0 con 0x7f4b10074860 2024-04-25T13:46:41.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10071830 con 0x7f4b1006d6c0 2024-04-25T13:46:41.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f4b10071b30 con 0x7f4b10151e50 2024-04-25T13:46:41.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10074860 0x7f4b10151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10074860 0x7f4b10151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37606/0 (socket says 172.21.15.77:37606) 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0ffff640 1 -- 172.21.15.77:0/1163322612 learned_addr learned my addr 172.21.15.77:0/1163322612 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b14eaa640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1006d6c0 0x7f4b1014c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b156ab640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10151e50 0x7f4b101eefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0ffff640 1 -- 172.21.15.77:0/1163322612 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10151e50 msgr2=0x7f4b101eefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0ffff640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10151e50 0x7f4b101eefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0ffff640 1 -- 172.21.15.77:0/1163322612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1006d6c0 msgr2=0x7f4b1014c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0ffff640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1006d6c0 0x7f4b1014c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0ffff640 1 -- 172.21.15.77:0/1163322612 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b101533b0 con 0x7f4b10074860 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b14eaa640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1006d6c0 0x7f4b1014c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0ffff640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10074860 0x7f4b10151180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400d5b0 tx=0x7f4b0400da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0d7fa640 1 -- 172.21.15.77:0/1163322612 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b04018020 con 0x7f4b10074860 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0d7fa640 1 -- 172.21.15.77:0/1163322612 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b04014620 con 0x7f4b10074860 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b10141d10 con 0x7f4b10074860 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b0d7fa640 1 -- 172.21.15.77:0/1163322612 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b040149d0 con 0x7f4b10074860 2024-04-25T13:46:41.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b10150d00 con 0x7f4b10074860 2024-04-25T13:46:41.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.014+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1006a1a0 con 0x7f4b10074860 2024-04-25T13:46:41.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.018+0000 7f4b0d7fa640 1 -- 172.21.15.77:0/1163322612 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4b0401b020 con 0x7f4b10074860 2024-04-25T13:46:41.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.018+0000 7f4b0d7fa640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4afc06f400 0x7f4afc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.018+0000 7f4b14eaa640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4afc06f400 0x7f4afc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.018+0000 7f4b0d7fa640 1 -- 172.21.15.77:0/1163322612 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f4b0408f7e0 con 0x7f4b10074860 2024-04-25T13:46:41.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.018+0000 7f4b14eaa640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4afc06f400 0x7f4afc071910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b08003fd0 tx=0x7f4b080039a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.022+0000 7f4b0d7fa640 1 -- 172.21.15.77:0/1163322612 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b04022020 con 0x7f4b10074860 2024-04-25T13:46:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.178+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4b1006f300 con 0x7f4b10074860 2024-04-25T13:46:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.178+0000 7f4b0d7fa640 1 -- 172.21.15.77:0/1163322612 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f4b0405c640 con 0x7f4b10074860 2024-04-25T13:46:41.179 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T13:46:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4afc06f400 msgr2=0x7f4afc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4afc06f400 0x7f4afc071910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b08003fd0 tx=0x7f4b080039a0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10074860 msgr2=0x7f4b10151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10074860 0x7f4b10151180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400d5b0 tx=0x7f4b0400da70 comp rx=0 tx=0).stop 2024-04-25T13:46:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 shutdown_connections 2024-04-25T13:46:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f4afc06f400 0x7f4afc071910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b10151e50 0x7f4b101eefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b10074860 0x7f4b10151180 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 --2- 172.21.15.77:0/1163322612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b1006d6c0 0x7f4b1014c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 >> 172.21.15.77:0/1163322612 conn(0x7f4b100a7d80 msgr2=0x7f4b100c2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 shutdown_connections 2024-04-25T13:46:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.182+0000 7f4b1710e640 1 -- 172.21.15.77:0/1163322612 wait complete. 2024-04-25T13:46:41.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:46:41.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:41.271 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:41.273 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:41.275 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:41.278 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:46:41.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff722d6c640 1 Processor -- start 2024-04-25T13:46:41.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff722d6c640 1 -- start start 2024-04-25T13:46:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff722d6c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c0bf910 0x7ff71c14e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff722d6c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff71c0a4b10 con 0x7ff71c152260 2024-04-25T13:46:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff722d6c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff71c0a4df0 con 0x7ff71c0c0b70 2024-04-25T13:46:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff722d6c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff71c0a50d0 con 0x7ff71c0bf910 2024-04-25T13:46:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff721309640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff71c152260 0x7ff71c152670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56488/0 (socket says 172.21.15.77:56488) 2024-04-25T13:46:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff721309640 1 -- 172.21.15.77:0/479928357 learned_addr learned my addr 172.21.15.77:0/479928357 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff720b08640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c0bf910 0x7ff71c14e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307259803 0 0) 0x7ff71c0a4b10 con 0x7ff71c152260 2024-04-25T13:46:41.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff704003530 con 0x7ff71c152260 2024-04-25T13:46:41.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1309211428 0 0) 0x7ff704003530 con 0x7ff71c152260 2024-04-25T13:46:41.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c0bf910 msgr2=0x7ff71c14e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:41.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c0bf910 0x7ff71c14e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 >> v1:172.21.15.96:6789/0 conn(0x7ff71c0c0b70 legacy=0x7ff71c14f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c0a2fb0 con 0x7ff71c152260 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7ff714001a00 con 0x7ff71c152260 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 >> v1:172.21.15.77:6789/0 conn(0x7ff71c152260 legacy=0x7ff71c152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff704003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff704004810 0x7ff704004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c0bf910 0x7ff7040052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c0a50d0 con 0x7ff704003a60 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff70400bb60 con 0x7ff704004810 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff70400bd60 con 0x7ff71c0bf910 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.342+0000 7ff720b08640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff704003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff71bfff640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff704004810 0x7ff704004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff721309640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c0bf910 0x7ff7040052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff720b08640 1 -- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c0bf910 msgr2=0x7ff7040052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff720b08640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c0bf910 0x7ff7040052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff720b08640 1 -- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff704004810 msgr2=0x7ff704004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:41.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff720b08640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff704004810 0x7ff704004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff720b08640 1 -- 172.21.15.77:0/479928357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff704003530 con 0x7ff704003a60 2024-04-25T13:46:41.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff721309640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c0bf910 0x7ff7040052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff720b08640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff704003ed0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff710009ab0 tx=0x7ff71001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528a8c2441c48b51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7100096b0 con 0x7ff704003a60 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7100a8430 con 0x7ff704003a60 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff71b7fe640 1 -- 172.21.15.77:0/479928357 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7100a87e0 con 0x7ff704003a60 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff722d6c640 1 -- 172.21.15.77:0/479928357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 msgr2=0x7ff704003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff722d6c640 1 --2- 172.21.15.77:0/479928357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff704003ed0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff710009ab0 tx=0x7ff71001ca70 comp rx=0 tx=0).stop 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff721309640 1 -- 172.21.15.77:0/479928357 reap_dead start 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff722d6c640 1 -- 172.21.15.77:0/479928357 shutdown_connections 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff722d6c640 1 -- 172.21.15.77:0/479928357 >> 172.21.15.77:0/479928357 conn(0x7ff71c0c3cd0 msgr2=0x7ff71c0c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff722d6c640 1 -- 172.21.15.77:0/479928357 shutdown_connections 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.346+0000 7ff722d6c640 1 -- 172.21.15.77:0/479928357 wait complete. 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 Processor -- start 2024-04-25T13:46:41.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 -- start start 2024-04-25T13:46:41.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff71c1efb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c151a70 0x7ff71c0a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff71c14db50 0x7ff71c14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c15a590 con 0x7ff704003a60 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c15a410 con 0x7ff71c14db50 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff71c15a710 con 0x7ff71c151a70 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff720b08640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff71c1efb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff720b08640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff71c1efb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37626/0 (socket says 172.21.15.77:37626) 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff720b08640 1 -- 172.21.15.77:0/570081126 learned_addr learned my addr 172.21.15.77:0/570081126 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff721309640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff71c14db50 0x7ff71c14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff71bfff640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c151a70 0x7ff71c0a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff720b08640 1 -- 172.21.15.77:0/570081126 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c151a70 msgr2=0x7ff71c0a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff720b08640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c151a70 0x7ff71c0a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff720b08640 1 -- 172.21.15.77:0/570081126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff71c14db50 msgr2=0x7ff71c14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff720b08640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff71c14db50 0x7ff71c14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff720b08640 1 -- 172.21.15.77:0/570081126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c0a1fa0 con 0x7ff704003a60 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff720b08640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff71c1efb70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff71001c8a0 tx=0x7ff710019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff7197fa640 1 -- 172.21.15.77:0/570081126 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7100096b0 con 0x7ff704003a60 2024-04-25T13:46:41.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff7197fa640 1 -- 172.21.15.77:0/570081126 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7100a8be0 con 0x7ff704003a60 2024-04-25T13:46:41.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff7197fa640 1 -- 172.21.15.77:0/570081126 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7100ba440 con 0x7ff704003a60 2024-04-25T13:46:41.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71c1ef370 con 0x7ff704003a60 2024-04-25T13:46:41.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.350+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71c0a06c0 con 0x7ff704003a60 2024-04-25T13:46:41.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.354+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff71c06a1a0 con 0x7ff704003a60 2024-04-25T13:46:41.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.354+0000 7ff7197fa640 1 -- 172.21.15.77:0/570081126 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff7100c4420 con 0x7ff704003a60 2024-04-25T13:46:41.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.354+0000 7ff7197fa640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff70806f400 0x7ff708071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.354+0000 7ff71bfff640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff70806f400 0x7ff708071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.354+0000 7ff7197fa640 1 -- 172.21.15.77:0/570081126 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ff710129480 con 0x7ff704003a60 2024-04-25T13:46:41.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.354+0000 7ff71bfff640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff70806f400 0x7ff708071910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff71c073880 tx=0x7ff70c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.358+0000 7ff7197fa640 1 -- 172.21.15.77:0/570081126 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff7100c0060 con 0x7ff704003a60 2024-04-25T13:46:41.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff71c0c0520 con 0x7ff704003a60 2024-04-25T13:46:41.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff7197fa640 1 -- 172.21.15.77:0/570081126 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7ff7100b6070 con 0x7ff704003a60 2024-04-25T13:46:41.507 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff70806f400 msgr2=0x7ff708071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff70806f400 0x7ff708071910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff71c073880 tx=0x7ff70c009040 comp rx=0 tx=0).stop 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 msgr2=0x7ff71c1efb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff71c1efb70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff71001c8a0 tx=0x7ff710019810 comp rx=0 tx=0).stop 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 shutdown_connections 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff70806f400 0x7ff708071910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff71c14db50 0x7ff71c14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff71c151a70 0x7ff71c0a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 --2- 172.21.15.77:0/570081126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff704003a60 0x7ff71c1efb70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 >> 172.21.15.77:0/570081126 conn(0x7ff71c0c3cd0 msgr2=0x7ff71c0a8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 shutdown_connections 2024-04-25T13:46:41.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.506+0000 7ff722d6c640 1 -- 172.21.15.77:0/570081126 wait complete. 2024-04-25T13:46:41.526 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:46:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bff529640 1 Processor -- start 2024-04-25T13:46:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bff529640 1 -- start start 2024-04-25T13:46:41.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bff529640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1bf80c69b0 0x7f1bf806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bff529640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1bf80a6870 0x7f1bf80a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bff529640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 0x7f1bf80c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bff529640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf8153480 con 0x7f1bf80a6870 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bff529640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf80a71c0 con 0x7f1bf80c69b0 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bff529640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf81529a0 con 0x7f1bf80c1ee0 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfcac4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1bf80a6870 0x7f1bf80a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfcac4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1bf80a6870 0x7f1bf80a6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37632/0 (socket says 172.21.15.77:37632) 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfcac4640 1 -- 172.21.15.77:0/2019800261 learned_addr learned my addr 172.21.15.77:0/2019800261 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfdac6640 1 --2- 172.21.15.77:0/2019800261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 0x7f1bf80c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfd2c5640 1 --2- 172.21.15.77:0/2019800261 >> v2:172.21.15.96:3300/0 conn(0x7f1bf80c69b0 0x7f1bf806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfcac4640 1 -- 172.21.15.77:0/2019800261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 msgr2=0x7f1bf80c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfcac4640 1 --2- 172.21.15.77:0/2019800261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 0x7f1bf80c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfcac4640 1 -- 172.21.15.77:0/2019800261 >> v2:172.21.15.96:3300/0 conn(0x7f1bf80c69b0 msgr2=0x7f1bf806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfcac4640 1 --2- 172.21.15.77:0/2019800261 >> v2:172.21.15.96:3300/0 conn(0x7f1bf80c69b0 0x7f1bf806dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfcac4640 1 -- 172.21.15.77:0/2019800261 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf8152c80 con 0x7f1bf80a6870 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfdac6640 1 --2- 172.21.15.77:0/2019800261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 0x7f1bf80c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.662+0000 7f1bfd2c5640 1 --2- 172.21.15.77:0/2019800261 >> v2:172.21.15.96:3300/0 conn(0x7f1bf80c69b0 0x7f1bf806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:41.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bfcac4640 1 --2- 172.21.15.77:0/2019800261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80a6870 0x7f1bf80a6c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1bf808d220 tx=0x7f1be801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b0138f08eb30a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1beffff640 1 -- 172.21.15.77:0/2019800261 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be80b1070 con 0x7f1bf80a6870 2024-04-25T13:46:41.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1beffff640 1 -- 172.21.15.77:0/2019800261 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be80a8050 con 0x7f1bf80a6870 2024-04-25T13:46:41.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1beffff640 1 -- 172.21.15.77:0/2019800261 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be80ac860 con 0x7f1bf80a6870 2024-04-25T13:46:41.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 -- 172.21.15.77:0/2019800261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80a6870 msgr2=0x7f1bf80a6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 --2- 172.21.15.77:0/2019800261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80a6870 0x7f1bf80a6c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1bf808d220 tx=0x7f1be801c460 comp rx=0 tx=0).stop 2024-04-25T13:46:41.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 -- 172.21.15.77:0/2019800261 shutdown_connections 2024-04-25T13:46:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 --2- 172.21.15.77:0/2019800261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 0x7f1bf80c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 --2- 172.21.15.77:0/2019800261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80a6870 0x7f1bf80a6c80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 --2- 172.21.15.77:0/2019800261 >> v2:172.21.15.96:3300/0 conn(0x7f1bf80c69b0 0x7f1bf806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 -- 172.21.15.77:0/2019800261 >> 172.21.15.77:0/2019800261 conn(0x7f1bf80c7890 msgr2=0x7f1bf80c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 -- 172.21.15.77:0/2019800261 shutdown_connections 2024-04-25T13:46:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 -- 172.21.15.77:0/2019800261 wait complete. 2024-04-25T13:46:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 Processor -- start 2024-04-25T13:46:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 -- start start 2024-04-25T13:46:41.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf80a6870 0x7f1bf80c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 0x7f1bf814c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80c69b0 0x7f1bf80ba280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf80c6120 con 0x7f1bf80c69b0 2024-04-25T13:46:41.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf80c5fa0 con 0x7f1bf80a6870 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.666+0000 7f1bff529640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf80c62a0 con 0x7f1bf80c1ee0 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfdac6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80c69b0 0x7f1bf80ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfdac6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80c69b0 0x7f1bf80ba280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37634/0 (socket says 172.21.15.77:37634) 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfdac6640 1 -- 172.21.15.77:0/2387602136 learned_addr learned my addr 172.21.15.77:0/2387602136 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfcac4640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 0x7f1bf814c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfd2c5640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf80a6870 0x7f1bf80c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfdac6640 1 -- 172.21.15.77:0/2387602136 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 msgr2=0x7f1bf814c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfdac6640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 0x7f1bf814c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfdac6640 1 -- 172.21.15.77:0/2387602136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf80a6870 msgr2=0x7f1bf80c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfdac6640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf80a6870 0x7f1bf80c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfdac6640 1 -- 172.21.15.77:0/2387602136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf80bb4d0 con 0x7f1bf80c69b0 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfdac6640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80c69b0 0x7f1bf80ba280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000cd40 tx=0x7f1bf000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bedffb640 1 -- 172.21.15.77:0/2387602136 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000f680 con 0x7f1bf80c69b0 2024-04-25T13:46:41.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bedffb640 1 -- 172.21.15.77:0/2387602136 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf000f840 con 0x7f1bf80c69b0 2024-04-25T13:46:41.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf80bb7b0 con 0x7f1bf80c69b0 2024-04-25T13:46:41.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bedffb640 1 -- 172.21.15.77:0/2387602136 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000fc30 con 0x7f1bf80c69b0 2024-04-25T13:46:41.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf814b8e0 con 0x7f1bf80c69b0 2024-04-25T13:46:41.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf806a1a0 con 0x7f1bf80c69b0 2024-04-25T13:46:41.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bedffb640 1 -- 172.21.15.77:0/2387602136 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1bf00213f0 con 0x7f1bf80c69b0 2024-04-25T13:46:41.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bedffb640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1bdc06f400 0x7f1bdc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bedffb640 1 -- 172.21.15.77:0/2387602136 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f1bf008ff90 con 0x7f1bf80c69b0 2024-04-25T13:46:41.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfd2c5640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1bdc06f400 0x7f1bdc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.670+0000 7f1bfd2c5640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1bdc06f400 0x7f1bdc071910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006fd0 tx=0x7f1bf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.674+0000 7f1bedffb640 1 -- 172.21.15.77:0/2387602136 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1bf0014030 con 0x7f1bf80c69b0 2024-04-25T13:46:41.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.822+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1bf806ef40 con 0x7f1bf80c69b0 2024-04-25T13:46:41.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bedffb640 1 -- 172.21.15.77:0/2387602136 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f1bf005cf10 con 0x7f1bf80c69b0 2024-04-25T13:46:41.826 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T13:46:41.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1bdc06f400 msgr2=0x7f1bdc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1bdc06f400 0x7f1bdc071910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006fd0 tx=0x7f1bf4008040 comp rx=0 tx=0).stop 2024-04-25T13:46:41.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80c69b0 msgr2=0x7f1bf80ba280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80c69b0 0x7f1bf80ba280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000cd40 tx=0x7f1bf000a650 comp rx=0 tx=0).stop 2024-04-25T13:46:41.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 shutdown_connections 2024-04-25T13:46:41.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1bdc06f400 0x7f1bdc071910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bf80c69b0 0x7f1bf80ba280 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1bf80c1ee0 0x7f1bf814c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 --2- 172.21.15.77:0/2387602136 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf80a6870 0x7f1bf80c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 >> 172.21.15.77:0/2387602136 conn(0x7f1bf80c7890 msgr2=0x7f1bf80c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 shutdown_connections 2024-04-25T13:46:41.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.826+0000 7f1bff529640 1 -- 172.21.15.77:0/2387602136 wait complete. 2024-04-25T13:46:41.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:46:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.986+0000 7f9784ca9640 1 Processor -- start 2024-04-25T13:46:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.986+0000 7f9784ca9640 1 -- start start 2024-04-25T13:46:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f9784ca9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f978006fba0 0x7f978014f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f9784ca9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f978014fc40 0x7f9780153870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f9784ca9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97800741b0 con 0x7f9780153db0 2024-04-25T13:46:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f9784ca9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f9780071b10 con 0x7f978014fc40 2024-04-25T13:46:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f9784ca9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f97800bfe40 con 0x7f978006fba0 2024-04-25T13:46:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977dd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f978014fc40 0x7f9780153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977e59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f978006fba0 0x7f978014f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977dd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f978014fc40 0x7f9780153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:46872/0 (socket says 172.21.15.77:46872) 2024-04-25T13:46:41.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977dd9b640 1 -- 172.21.15.77:0/2197496338 learned_addr learned my addr 172.21.15.77:0/2197496338 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977e59c640 1 -- 172.21.15.77:0/2197496338 >> v2:172.21.15.96:3300/0 conn(0x7f978014fc40 msgr2=0x7f9780153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977e59c640 1 --2- 172.21.15.77:0/2197496338 >> v2:172.21.15.96:3300/0 conn(0x7f978014fc40 0x7f9780153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977e59c640 1 -- 172.21.15.77:0/2197496338 >> v1:172.21.15.96:6789/0 conn(0x7f9780153db0 legacy=0x7f9780072e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977e59c640 1 -- 172.21.15.77:0/2197496338 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9780150050 con 0x7f978006fba0 2024-04-25T13:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977dd9b640 1 --2- 172.21.15.77:0/2197496338 >> v2:172.21.15.96:3300/0 conn(0x7f978014fc40 0x7f9780153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977e59c640 1 --2- 172.21.15.77:0/2197496338 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f978006fba0 0x7f978014f700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f97700097c0 tx=0x7f977001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8082590dd941f5c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977d59a640 1 -- 172.21.15.77:0/2197496338 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b0070 con 0x7f978006fba0 2024-04-25T13:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977d59a640 1 -- 172.21.15.77:0/2197496338 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700ab600 con 0x7f978006fba0 2024-04-25T13:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.990+0000 7f977d59a640 1 -- 172.21.15.77:0/2197496338 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700ab9d0 con 0x7f978006fba0 2024-04-25T13:46:41.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 -- 172.21.15.77:0/2197496338 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f978006fba0 msgr2=0x7f978014f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 --2- 172.21.15.77:0/2197496338 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f978006fba0 0x7f978014f700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f97700097c0 tx=0x7f977001c410 comp rx=0 tx=0).stop 2024-04-25T13:46:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 -- 172.21.15.77:0/2197496338 shutdown_connections 2024-04-25T13:46:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 --2- 172.21.15.77:0/2197496338 >> v2:172.21.15.96:3300/0 conn(0x7f978014fc40 0x7f9780153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 --2- 172.21.15.77:0/2197496338 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f978006fba0 0x7f978014f700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 -- 172.21.15.77:0/2197496338 >> 172.21.15.77:0/2197496338 conn(0x7f97800c3cd0 msgr2=0x7f97800c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 -- 172.21.15.77:0/2197496338 shutdown_connections 2024-04-25T13:46:41.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 -- 172.21.15.77:0/2197496338 wait complete. 2024-04-25T13:46:41.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 Processor -- start 2024-04-25T13:46:41.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 -- start start 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978006fba0 0x7f978009fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978014fc40 0x7f978014b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9780153db0 0x7f978014a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f978015dc20 con 0x7f978006fba0 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f97800a8cc0 con 0x7f978014fc40 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f9784ca9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f978015dda0 con 0x7f9780153db0 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f977e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978006fba0 0x7f978009fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f977e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978006fba0 0x7f978009fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37648/0 (socket says 172.21.15.77:37648) 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f977e59c640 1 -- 172.21.15.77:0/4264226065 learned_addr learned my addr 172.21.15.77:0/4264226065 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f977dd9b640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978014fc40 0x7f978014b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.994+0000 7f977ed9d640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9780153db0 0x7f978014a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f977e59c640 1 -- 172.21.15.77:0/4264226065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9780153db0 msgr2=0x7f978014a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f977e59c640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9780153db0 0x7f978014a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f977e59c640 1 -- 172.21.15.77:0/4264226065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978014fc40 msgr2=0x7f978014b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f977e59c640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978014fc40 0x7f978014b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f977e59c640 1 -- 172.21.15.77:0/4264226065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978015b200 con 0x7f978006fba0 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f977e59c640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978006fba0 0x7f978009fe70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f977001a040 tx=0x7f977001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f976effd640 1 -- 172.21.15.77:0/4264226065 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b0050 con 0x7f978006fba0 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f976effd640 1 -- 172.21.15.77:0/4264226065 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700bc070 con 0x7f978006fba0 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978015aca0 con 0x7f978006fba0 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f976effd640 1 -- 172.21.15.77:0/4264226065 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770006e20 con 0x7f978006fba0 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97800a23f0 con 0x7f978006fba0 2024-04-25T13:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978006a1a0 con 0x7f978006fba0 2024-04-25T13:46:42.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f976effd640 1 -- 172.21.15.77:0/4264226065 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f97700b5830 con 0x7f978006fba0 2024-04-25T13:46:42.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f976effd640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f976006f430 0x7f9760071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:42.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f976effd640 1 -- 172.21.15.77:0/4264226065 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f977012a540 con 0x7f978006fba0 2024-04-25T13:46:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f977dd9b640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f976006f430 0x7f9760071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:42.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:41.998+0000 7f977dd9b640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f976006f430 0x7f9760071940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97801535b0 tx=0x7f9774008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:42.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.002+0000 7f976effd640 1 -- 172.21.15.77:0/4264226065 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9770016090 con 0x7f978006fba0 2024-04-25T13:46:42.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f978014e960 con 0x7f978006fba0 2024-04-25T13:46:42.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f976effd640 1 -- 172.21.15.77:0/4264226065 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f97700f7510 con 0x7f978006fba0 2024-04-25T13:46:42.162 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-04-25T13:46:42.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f976006f430 msgr2=0x7f9760071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:42.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f976006f430 0x7f9760071940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97801535b0 tx=0x7f9774008040 comp rx=0 tx=0).stop 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978006fba0 msgr2=0x7f978009fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978006fba0 0x7f978009fe70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f977001a040 tx=0x7f977001ac50 comp rx=0 tx=0).stop 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 shutdown_connections 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f976006f430 0x7f9760071940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9780153db0 0x7f978014a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f978014fc40 0x7f978014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 --2- 172.21.15.77:0/4264226065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978006fba0 0x7f978009fe70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 >> 172.21.15.77:0/4264226065 conn(0x7f97800c3cd0 msgr2=0x7f9780150ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 shutdown_connections 2024-04-25T13:46:42.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:42.162+0000 7f9784ca9640 1 -- 172.21.15.77:0/4264226065 wait complete. 2024-04-25T13:46:42.182 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi097.front.sepia.ceph.com... 2024-04-25T13:46:42.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:46:42.182 DEBUG:teuthology.orchestra.run.smithi097:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T13:46:42.203 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:ceph-fuse[22906]: fuse finished with error 0 and tester_r 0 2024-04-25T13:46:42.204 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:46:48.306 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2024-04-25T13:46:48.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:46:48.306 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T13:46:48.314 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:46:48.314 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:46:48.320 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:46:48.320 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:46:48.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:46:48.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.530+0000 7ff262a09640 1 Processor -- start 2024-04-25T13:46:48.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.530+0000 7ff262a09640 1 -- start start 2024-04-25T13:46:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff262a09640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff25c06d6c0 0x7ff25c0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff262a09640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 0x7ff25c151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff262a09640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c06e8c0 con 0x7ff25c1518b0 2024-04-25T13:46:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff262a09640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff25c152200 con 0x7ff25c06d6c0 2024-04-25T13:46:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff262a09640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c153460 con 0x7ff25c153050 2024-04-25T13:46:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff260fa6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 0x7ff25c151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff25bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff25c06d6c0 0x7ff25c0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff25bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff25c06d6c0 0x7ff25c0c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:46892/0 (socket says 172.21.15.77:46892) 2024-04-25T13:46:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff260fa6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 0x7ff25c151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:58284/0 (socket says 172.21.15.77:58284) 2024-04-25T13:46:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff25bfff640 1 -- 172.21.15.77:0/3172202885 learned_addr learned my addr 172.21.15.77:0/3172202885 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff25bfff640 1 -- 172.21.15.77:0/3172202885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 msgr2=0x7ff25c151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff25bfff640 1 --2- 172.21.15.77:0/3172202885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 0x7ff25c151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff25bfff640 1 -- 172.21.15.77:0/3172202885 >> v1:172.21.15.96:6789/0 conn(0x7ff25c1518b0 legacy=0x7ff25c152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.534+0000 7ff25bfff640 1 -- 172.21.15.77:0/3172202885 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c0c65f0 con 0x7ff25c06d6c0 2024-04-25T13:46:48.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff25bfff640 1 --2- 172.21.15.77:0/3172202885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff25c06d6c0 0x7ff25c0c60b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff250009870 tx=0x7ff25001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e11271877f94443 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:48.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff25affd640 1 -- 172.21.15.77:0/3172202885 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2500b1070 con 0x7ff25c06d6c0 2024-04-25T13:46:48.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff25affd640 1 -- 172.21.15.77:0/3172202885 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2500a8050 con 0x7ff25c06d6c0 2024-04-25T13:46:48.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff25affd640 1 -- 172.21.15.77:0/3172202885 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2500ac860 con 0x7ff25c06d6c0 2024-04-25T13:46:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 -- 172.21.15.77:0/3172202885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff25c06d6c0 msgr2=0x7ff25c0c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 --2- 172.21.15.77:0/3172202885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff25c06d6c0 0x7ff25c0c60b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff250009870 tx=0x7ff25001c4d0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 -- 172.21.15.77:0/3172202885 shutdown_connections 2024-04-25T13:46:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 --2- 172.21.15.77:0/3172202885 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 0x7ff25c151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 --2- 172.21.15.77:0/3172202885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff25c06d6c0 0x7ff25c0c60b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 -- 172.21.15.77:0/3172202885 >> 172.21.15.77:0/3172202885 conn(0x7ff25c0a7b80 msgr2=0x7ff25c0c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:48.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 -- 172.21.15.77:0/3172202885 shutdown_connections 2024-04-25T13:46:48.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 -- 172.21.15.77:0/3172202885 wait complete. 2024-04-25T13:46:48.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 Processor -- start 2024-04-25T13:46:48.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.538+0000 7ff262a09640 1 -- start start 2024-04-25T13:46:48.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff262a09640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff25c06d6c0 0x7ff25c148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff262a09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c1518b0 0x7ff25c148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff262a09640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 0x7ff25c144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff262a09640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c15f610 con 0x7ff25c1518b0 2024-04-25T13:46:48.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff262a09640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c15f490 con 0x7ff25c06d6c0 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff262a09640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c15f790 con 0x7ff25c153050 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c1518b0 0x7ff25c148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c1518b0 0x7ff25c148aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37664/0 (socket says 172.21.15.77:37664) 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25b7fe640 1 -- 172.21.15.77:0/1549673541 learned_addr learned my addr 172.21.15.77:0/1549673541 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff260fa6640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 0x7ff25c144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25bfff640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff25c06d6c0 0x7ff25c148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25b7fe640 1 -- 172.21.15.77:0/1549673541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 msgr2=0x7ff25c144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25b7fe640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 0x7ff25c144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25b7fe640 1 -- 172.21.15.77:0/1549673541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff25c06d6c0 msgr2=0x7ff25c148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25b7fe640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff25c06d6c0 0x7ff25c148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25b7fe640 1 -- 172.21.15.77:0/1549673541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c1ec420 con 0x7ff25c1518b0 2024-04-25T13:46:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff25b7fe640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c1518b0 0x7ff25c148aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00c370 tx=0x7ff24c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:48.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff258ff9640 1 -- 172.21.15.77:0/1549673541 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0052d0 con 0x7ff25c1518b0 2024-04-25T13:46:48.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff258ff9640 1 -- 172.21.15.77:0/1549673541 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c005470 con 0x7ff25c1518b0 2024-04-25T13:46:48.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c14ec70 con 0x7ff25c1518b0 2024-04-25T13:46:48.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff258ff9640 1 -- 172.21.15.77:0/1549673541 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c007260 con 0x7ff25c1518b0 2024-04-25T13:46:48.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c148fe0 con 0x7ff25c1518b0 2024-04-25T13:46:48.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25c06a280 con 0x7ff25c1518b0 2024-04-25T13:46:48.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff258ff9640 1 -- 172.21.15.77:0/1549673541 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff24c007400 con 0x7ff25c1518b0 2024-04-25T13:46:48.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff258ff9640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff24806f400 0x7ff248071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.542+0000 7ff258ff9640 1 -- 172.21.15.77:0/1549673541 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ff24c08e740 con 0x7ff25c1518b0 2024-04-25T13:46:48.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.546+0000 7ff25bfff640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff24806f400 0x7ff248071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.546+0000 7ff25bfff640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff24806f400 0x7ff248071910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff2500ae000 tx=0x7ff250008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:48.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.550+0000 7ff258ff9640 1 -- 172.21.15.77:0/1549673541 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff24c05af50 con 0x7ff25c1518b0 2024-04-25T13:46:48.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.702+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff25c0c5c30 con 0x7ff25c1518b0 2024-04-25T13:46:48.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.702+0000 7ff258ff9640 1 -- 172.21.15.77:0/1549673541 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16853 (secure 0 0 0) 0x7ff24c05f250 con 0x7ff25c1518b0 2024-04-25T13:46:48.705 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:46:48.705 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:51.564949+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:46:48.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff24806f400 msgr2=0x7ff248071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff24806f400 0x7ff248071910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff2500ae000 tx=0x7ff250008040 comp rx=0 tx=0).stop 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c1518b0 msgr2=0x7ff25c148aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c1518b0 0x7ff25c148aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00c370 tx=0x7ff24c00c830 comp rx=0 tx=0).stop 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 shutdown_connections 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff24806f400 0x7ff248071910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff25c153050 0x7ff25c144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff25c1518b0 0x7ff25c148aa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 --2- 172.21.15.77:0/1549673541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff25c06d6c0 0x7ff25c148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 >> 172.21.15.77:0/1549673541 conn(0x7ff25c0a7b80 msgr2=0x7ff25c0c1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 shutdown_connections 2024-04-25T13:46:48.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.706+0000 7ff262a09640 1 -- 172.21.15.77:0/1549673541 wait complete. 2024-04-25T13:46:48.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:40:58.420007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:41:01.460651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:41:02.746892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:46:48.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:46:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7b05586640 1 Processor -- start 2024-04-25T13:46:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7b05586640 1 -- start start 2024-04-25T13:46:48.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7b05586640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b0014d350 0x7f7b0014d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7b05586640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b001502c0 0x7f7b001506d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7b05586640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b000aadb0 con 0x7f7b00074690 2024-04-25T13:46:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7b05586640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7b00154530 con 0x7f7b0014d350 2024-04-25T13:46:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7b05586640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7b000aa880 con 0x7f7b001502c0 2024-04-25T13:46:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7af7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b0014d350 0x7f7b0014d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7af7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b0014d350 0x7f7b0014d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37680/0 (socket says 172.21.15.77:37680) 2024-04-25T13:46:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7af7fff640 1 -- 172.21.15.77:0/2184039105 learned_addr learned my addr 172.21.15.77:0/2184039105 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7aff7fe640 1 --2- 172.21.15.77:0/2184039105 >> v2:172.21.15.96:3300/0 conn(0x7f7b001502c0 0x7f7b001506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7af7fff640 1 -- 172.21.15.77:0/2184039105 >> v2:172.21.15.96:3300/0 conn(0x7f7b001502c0 msgr2=0x7f7b001506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7af7fff640 1 --2- 172.21.15.77:0/2184039105 >> v2:172.21.15.96:3300/0 conn(0x7f7b001502c0 0x7f7b001506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7af7fff640 1 -- 172.21.15.77:0/2184039105 >> v1:172.21.15.96:6789/0 conn(0x7f7b00074690 legacy=0x7f7b00073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.874+0000 7f7af7fff640 1 -- 172.21.15.77:0/2184039105 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b000aaad0 con 0x7f7b0014d350 2024-04-25T13:46:48.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.878+0000 7f7af7fff640 1 --2- 172.21.15.77:0/2184039105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0014d350 0x7f7b0014d760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ab190 tx=0x7f7ae801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917fdc2e7ca3d1bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:48.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.878+0000 7f7afe7fc640 1 -- 172.21.15.77:0/2184039105 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80b2070 con 0x7f7b0014d350 2024-04-25T13:46:48.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.878+0000 7f7afe7fc640 1 -- 172.21.15.77:0/2184039105 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae80ad680 con 0x7f7b0014d350 2024-04-25T13:46:48.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.878+0000 7f7afe7fc640 1 -- 172.21.15.77:0/2184039105 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80ada50 con 0x7f7b0014d350 2024-04-25T13:46:48.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 -- 172.21.15.77:0/2184039105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0014d350 msgr2=0x7f7b0014d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 --2- 172.21.15.77:0/2184039105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0014d350 0x7f7b0014d760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ab190 tx=0x7f7ae801c470 comp rx=0 tx=0).stop 2024-04-25T13:46:48.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 -- 172.21.15.77:0/2184039105 shutdown_connections 2024-04-25T13:46:48.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 --2- 172.21.15.77:0/2184039105 >> v2:172.21.15.96:3300/0 conn(0x7f7b001502c0 0x7f7b001506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 --2- 172.21.15.77:0/2184039105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0014d350 0x7f7b0014d760 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 -- 172.21.15.77:0/2184039105 >> 172.21.15.77:0/2184039105 conn(0x7f7b000a7d80 msgr2=0x7f7b000c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 -- 172.21.15.77:0/2184039105 shutdown_connections 2024-04-25T13:46:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 -- 172.21.15.77:0/2184039105 wait complete. 2024-04-25T13:46:48.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 Processor -- start 2024-04-25T13:46:48.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 -- start start 2024-04-25T13:46:48.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b00074690 0x7f7b00148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b0014d350 0x7f7b0014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b001502c0 0x7f7b00142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0015d7f0 con 0x7f7b001502c0 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0015d670 con 0x7f7b00074690 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7b05586640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0015d970 con 0x7f7b0014d350 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7aff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b001502c0 0x7f7b00142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7aff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b001502c0 0x7f7b00142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37686/0 (socket says 172.21.15.77:37686) 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7aff7fe640 1 -- 172.21.15.77:0/137490032 learned_addr learned my addr 172.21.15.77:0/137490032 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7afeffd640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b00074690 0x7f7b00148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7af7fff640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b0014d350 0x7f7b0014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7aff7fe640 1 -- 172.21.15.77:0/137490032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b0014d350 msgr2=0x7f7b0014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7aff7fe640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b0014d350 0x7f7b0014bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7aff7fe640 1 -- 172.21.15.77:0/137490032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b00074690 msgr2=0x7f7b00148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7aff7fe640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b00074690 0x7f7b00148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.882+0000 7f7aff7fe640 1 -- 172.21.15.77:0/137490032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b001ee0c0 con 0x7f7b001502c0 2024-04-25T13:46:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7aff7fe640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b001502c0 0x7f7b00142ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7af800efc0 tx=0x7f7af800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7af77fe640 1 -- 172.21.15.77:0/137490032 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8018020 con 0x7f7b001502c0 2024-04-25T13:46:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7af77fe640 1 -- 172.21.15.77:0/137490032 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af8014480 con 0x7f7b001502c0 2024-04-25T13:46:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b001edd50 con 0x7f7b001502c0 2024-04-25T13:46:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7af77fe640 1 -- 172.21.15.77:0/137490032 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8009e60 con 0x7f7b001502c0 2024-04-25T13:46:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b001492f0 con 0x7f7b001502c0 2024-04-25T13:46:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b0006a1a0 con 0x7f7b001502c0 2024-04-25T13:46:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7af77fe640 1 -- 172.21.15.77:0/137490032 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7af801b020 con 0x7f7b001502c0 2024-04-25T13:46:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7af77fe640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7ae006f430 0x7f7ae0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7af77fe640 1 -- 172.21.15.77:0/137490032 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f7af8090000 con 0x7f7b001502c0 2024-04-25T13:46:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7afeffd640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7ae006f430 0x7f7ae0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.886+0000 7f7afeffd640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7ae006f430 0x7f7ae0071940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ab3c0 tx=0x7f7af0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:48.890+0000 7f7af77fe640 1 -- 172.21.15.77:0/137490032 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7af8022030 con 0x7f7b001502c0 2024-04-25T13:46:49.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.042+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7b0015aa20 con 0x7f7b001502c0 2024-04-25T13:46:49.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.042+0000 7f7af77fe640 1 -- 172.21.15.77:0/137490032 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f7af8010040 con 0x7f7b001502c0 2024-04-25T13:46:49.043 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T13:46:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.042+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7ae006f430 msgr2=0x7f7ae0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.042+0000 7f7b05586640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7ae006f430 0x7f7ae0071940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ab3c0 tx=0x7f7af0009040 comp rx=0 tx=0).stop 2024-04-25T13:46:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.042+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b001502c0 msgr2=0x7f7b00142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.042+0000 7f7b05586640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b001502c0 0x7f7b00142ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7af800efc0 tx=0x7f7af800c490 comp rx=0 tx=0).stop 2024-04-25T13:46:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.046+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 shutdown_connections 2024-04-25T13:46:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.046+0000 7f7b05586640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7ae006f430 0x7f7ae0071940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.046+0000 7f7b05586640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b001502c0 0x7f7b00142ab0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.046+0000 7f7b05586640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b0014d350 0x7f7b0014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.046+0000 7f7b05586640 1 --2- 172.21.15.77:0/137490032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b00074690 0x7f7b00148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.046+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 >> 172.21.15.77:0/137490032 conn(0x7f7b000a7d80 msgr2=0x7f7b00146cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.046+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 shutdown_connections 2024-04-25T13:46:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.046+0000 7f7b05586640 1 -- 172.21.15.77:0/137490032 wait complete. 2024-04-25T13:46:49.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:46:49.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.198+0000 7faf7f7f7640 1 Processor -- start 2024-04-25T13:46:49.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7f7f7640 1 -- start start 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7f7f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf7806fba0 0x7faf7814f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7f7f7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf780741b0 con 0x7faf78153f80 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7f7f7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf78071b10 con 0x7faf7814fc40 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7f7f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7faf780bfe40 con 0x7faf7806fba0 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7dd94640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7faf78153f80 0x7faf7815ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56498/0 (socket says 172.21.15.77:56498) 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7dd94640 1 -- 172.21.15.77:0/3807793706 learned_addr learned my addr 172.21.15.77:0/3807793706 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7d593640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf7806fba0 0x7faf7814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037936856 0 0) 0x7faf780741b0 con 0x7faf78153f80 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf64003530 con 0x7faf78153f80 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2551496029 0 0) 0x7faf64003530 con 0x7faf78153f80 2024-04-25T13:46:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf7806fba0 msgr2=0x7faf7814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf7806fba0 0x7faf7814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 >> v1:172.21.15.96:6789/0 conn(0x7faf7814fc40 legacy=0x7faf78153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf78150050 con 0x7faf78153f80 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7faf70001a00 con 0x7faf78153f80 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 >> v1:172.21.15.77:6789/0 conn(0x7faf78153f80 legacy=0x7faf7815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf7806fba0 0x7faf64003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf64003fc0 0x7faf64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf64005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf780bfe40 con 0x7faf64004d50 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7faf6400bc10 con 0x7faf64003fc0 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7faf6400be10 con 0x7faf7806fba0 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7dd94640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf64005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7d593640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf7806fba0 0x7faf64003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7cd92640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf64003fc0 0x7faf64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7dd94640 1 -- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf7806fba0 msgr2=0x7faf64003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7dd94640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf7806fba0 0x7faf64003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7dd94640 1 -- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf64003fc0 msgr2=0x7faf64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7dd94640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf64003fc0 0x7faf64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.202+0000 7faf7dd94640 1 -- 172.21.15.77:0/3807793706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf64003530 con 0x7faf64004d50 2024-04-25T13:46:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf7dd94640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf64005160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf7000a920 tx=0x7faf7001d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79541ac51c2fa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:49.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7000a4c0 con 0x7faf64004d50 2024-04-25T13:46:49.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf700ad650 con 0x7faf64004d50 2024-04-25T13:46:49.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf6ffff640 1 -- 172.21.15.77:0/3807793706 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf700a5e60 con 0x7faf64004d50 2024-04-25T13:46:49.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf7f7f7640 1 -- 172.21.15.77:0/3807793706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 msgr2=0x7faf64005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf7f7f7640 1 --2- 172.21.15.77:0/3807793706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf64005160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf7000a920 tx=0x7faf7001d420 comp rx=0 tx=0).stop 2024-04-25T13:46:49.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf7dd94640 1 -- 172.21.15.77:0/3807793706 reap_dead start 2024-04-25T13:46:49.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf7f7f7640 1 -- 172.21.15.77:0/3807793706 shutdown_connections 2024-04-25T13:46:49.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf7f7f7640 1 -- 172.21.15.77:0/3807793706 >> 172.21.15.77:0/3807793706 conn(0x7faf780c3cd0 msgr2=0x7faf780c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:49.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf7f7f7640 1 -- 172.21.15.77:0/3807793706 shutdown_connections 2024-04-25T13:46:49.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.206+0000 7faf7f7f7640 1 -- 172.21.15.77:0/3807793706 wait complete. 2024-04-25T13:46:49.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 Processor -- start 2024-04-25T13:46:49.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 -- start start 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf7815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf780a77c0 0x7faf78152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf78146700 0x7faf78146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf780a8cc0 con 0x7faf64004d50 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7faf780701c0 con 0x7faf78146700 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7faf7815cd40 con 0x7faf780a77c0 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7d593640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf7815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7d593640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf7815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37694/0 (socket says 172.21.15.77:37694) 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7d593640 1 -- 172.21.15.77:0/1064883705 learned_addr learned my addr 172.21.15.77:0/1064883705 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7cd92640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf780a77c0 0x7faf78152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7dd94640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf78146700 0x7faf78146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7d593640 1 -- 172.21.15.77:0/1064883705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf780a77c0 msgr2=0x7faf78152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7d593640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf780a77c0 0x7faf78152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7d593640 1 -- 172.21.15.77:0/1064883705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf78146700 msgr2=0x7faf78146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7d593640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf78146700 0x7faf78146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7d593640 1 -- 172.21.15.77:0/1064883705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf781580d0 con 0x7faf64004d50 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7cd92640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf780a77c0 0x7faf78152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7d593640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf7815b840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf740119d0 tx=0x7faf74011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf6dffb640 1 -- 172.21.15.77:0/1064883705 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7400fb50 con 0x7faf64004d50 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf6dffb640 1 -- 172.21.15.77:0/1064883705 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7400fcf0 con 0x7faf64004d50 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf6dffb640 1 -- 172.21.15.77:0/1064883705 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7400fea0 con 0x7faf64004d50 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf780a8630 con 0x7faf64004d50 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf78147050 con 0x7faf64004d50 2024-04-25T13:46:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.210+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7806a1a0 con 0x7faf64004d50 2024-04-25T13:46:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.214+0000 7faf6dffb640 1 -- 172.21.15.77:0/1064883705 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faf74012040 con 0x7faf64004d50 2024-04-25T13:46:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.214+0000 7faf6dffb640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7faf5c06f400 0x7faf5c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.214+0000 7faf6dffb640 1 -- 172.21.15.77:0/1064883705 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7faf7408fa30 con 0x7faf64004d50 2024-04-25T13:46:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.214+0000 7faf7cd92640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7faf5c06f400 0x7faf5c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.214+0000 7faf7cd92640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7faf5c06f400 0x7faf5c071910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf68007fd0 tx=0x7faf68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.218+0000 7faf6dffb640 1 -- 172.21.15.77:0/1064883705 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faf74019030 con 0x7faf64004d50 2024-04-25T13:46:49.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.362+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faf781482d0 con 0x7faf64004d50 2024-04-25T13:46:49.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf6dffb640 1 -- 172.21.15.77:0/1064883705 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7faf7405c9e0 con 0x7faf64004d50 2024-04-25T13:46:49.366 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T13:46:49.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7faf5c06f400 msgr2=0x7faf5c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7faf5c06f400 0x7faf5c071910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf68007fd0 tx=0x7faf68009040 comp rx=0 tx=0).stop 2024-04-25T13:46:49.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 msgr2=0x7faf7815b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf7815b840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf740119d0 tx=0x7faf74011e90 comp rx=0 tx=0).stop 2024-04-25T13:46:49.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 shutdown_connections 2024-04-25T13:46:49.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7faf5c06f400 0x7faf5c071910 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf78146700 0x7faf78146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf780a77c0 0x7faf78152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 --2- 172.21.15.77:0/1064883705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf64004d50 0x7faf7815b840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 >> 172.21.15.77:0/1064883705 conn(0x7faf780c3cd0 msgr2=0x7faf780c2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:49.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 shutdown_connections 2024-04-25T13:46:49.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.366+0000 7faf7f7f7640 1 -- 172.21.15.77:0/1064883705 wait complete. 2024-04-25T13:46:49.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:46:49.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f22f3b640 1 Processor -- start 2024-04-25T13:46:49.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f22f3b640 1 -- start start 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f22f3b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f1c073ba0 0x7f3f1c151b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f22f3b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3f1c156170 0x7f3f1c15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f22f3b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f1c074a30 con 0x7f3f1c152050 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f22f3b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3f1c06d9a0 con 0x7f3f1c073ba0 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f22f3b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f3f1c06d6c0 con 0x7f3f1c156170 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f20cd7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f1c073ba0 0x7f3f1c151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f20cd7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f1c073ba0 0x7f3f1c151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37710/0 (socket says 172.21.15.77:37710) 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f1bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3f1c152050 0x7f3f1c155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56506/0 (socket says 172.21.15.77:56506) 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f20cd7640 1 -- 172.21.15.77:0/1762435664 learned_addr learned my addr 172.21.15.77:0/1762435664 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f214d8640 1 --2- 172.21.15.77:0/1762435664 >> v2:172.21.15.96:3300/0 conn(0x7f3f1c156170 0x7f3f1c15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f20cd7640 1 -- 172.21.15.77:0/1762435664 >> v2:172.21.15.96:3300/0 conn(0x7f3f1c156170 msgr2=0x7f3f1c15cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:49.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f20cd7640 1 --2- 172.21.15.77:0/1762435664 >> v2:172.21.15.96:3300/0 conn(0x7f3f1c156170 0x7f3f1c15cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f20cd7640 1 -- 172.21.15.77:0/1762435664 >> v1:172.21.15.77:6789/0 conn(0x7f3f1c152050 legacy=0x7f3f1c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.522+0000 7f3f20cd7640 1 -- 172.21.15.77:0/1762435664 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c0a6e50 con 0x7f3f1c073ba0 2024-04-25T13:46:49.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f20cd7640 1 --2- 172.21.15.77:0/1762435664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c073ba0 0x7f3f1c151b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c06e030 tx=0x7f3f1401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2e0de9006e9fef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:49.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1762435664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f140a56a0 con 0x7f3f1c073ba0 2024-04-25T13:46:49.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1762435664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f140a5840 con 0x7f3f1c073ba0 2024-04-25T13:46:49.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f1b7fe640 1 -- 172.21.15.77:0/1762435664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f140a5c10 con 0x7f3f1c073ba0 2024-04-25T13:46:49.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f22f3b640 1 -- 172.21.15.77:0/1762435664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c073ba0 msgr2=0x7f3f1c151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f22f3b640 1 --2- 172.21.15.77:0/1762435664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c073ba0 0x7f3f1c151b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c06e030 tx=0x7f3f1401c8d0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f22f3b640 1 -- 172.21.15.77:0/1762435664 shutdown_connections 2024-04-25T13:46:49.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f22f3b640 1 --2- 172.21.15.77:0/1762435664 >> v2:172.21.15.96:3300/0 conn(0x7f3f1c156170 0x7f3f1c15cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f22f3b640 1 --2- 172.21.15.77:0/1762435664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c073ba0 0x7f3f1c151b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f22f3b640 1 -- 172.21.15.77:0/1762435664 >> 172.21.15.77:0/1762435664 conn(0x7f3f1c0a7d80 msgr2=0x7f3f1c0c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:49.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f22f3b640 1 -- 172.21.15.77:0/1762435664 shutdown_connections 2024-04-25T13:46:49.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.526+0000 7f3f22f3b640 1 -- 172.21.15.77:0/1762435664 wait complete. 2024-04-25T13:46:49.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 Processor -- start 2024-04-25T13:46:49.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 -- start start 2024-04-25T13:46:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c073ba0 0x7f3f1c14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c152050 0x7f3f1c1eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3f1c156170 0x7f3f1c148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c15fb50 con 0x7f3f1c152050 2024-04-25T13:46:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c15fcd0 con 0x7f3f1c073ba0 2024-04-25T13:46:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c15fe50 con 0x7f3f1c156170 2024-04-25T13:46:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c152050 0x7f3f1c1eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c152050 0x7f3f1c1eeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37722/0 (socket says 172.21.15.77:37722) 2024-04-25T13:46:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f1bfff640 1 -- 172.21.15.77:0/3125662601 learned_addr learned my addr 172.21.15.77:0/3125662601 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f214d8640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3f1c156170 0x7f3f1c148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f20cd7640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c073ba0 0x7f3f1c14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f1bfff640 1 -- 172.21.15.77:0/3125662601 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3f1c156170 msgr2=0x7f3f1c148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f1bfff640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3f1c156170 0x7f3f1c148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f1bfff640 1 -- 172.21.15.77:0/3125662601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c073ba0 msgr2=0x7f3f1c14d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f1bfff640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c073ba0 0x7f3f1c14d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f1bfff640 1 -- 172.21.15.77:0/3125662601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c0c0b90 con 0x7f3f1c152050 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f20cd7640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c073ba0 0x7f3f1c14d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f1bfff640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c152050 0x7f3f1c1eeb20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000c340 tx=0x7f3f1000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f197fa640 1 -- 172.21.15.77:0/3125662601 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f100074e0 con 0x7f3f1c152050 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f197fa640 1 -- 172.21.15.77:0/3125662601 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f100076a0 con 0x7f3f1c152050 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1c0c0e70 con 0x7f3f1c152050 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f197fa640 1 -- 172.21.15.77:0/3125662601 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10004a30 con 0x7f3f1c152050 2024-04-25T13:46:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1c14d8a0 con 0x7f3f1c152050 2024-04-25T13:46:49.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.530+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1c0c0150 con 0x7f3f1c152050 2024-04-25T13:46:49.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.534+0000 7f3f197fa640 1 -- 172.21.15.77:0/3125662601 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3f1001a020 con 0x7f3f1c152050 2024-04-25T13:46:49.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.534+0000 7f3f197fa640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3f0806f400 0x7f3f08071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.534+0000 7f3f197fa640 1 -- 172.21.15.77:0/3125662601 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f3f1008e9c0 con 0x7f3f1c152050 2024-04-25T13:46:49.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.534+0000 7f3f20cd7640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3f0806f400 0x7f3f08071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.534+0000 7f3f20cd7640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3f0806f400 0x7f3f08071910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3f140ae000 tx=0x7f3f140a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:49.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.538+0000 7f3f197fa640 1 -- 172.21.15.77:0/3125662601 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f10090e20 con 0x7f3f1c152050 2024-04-25T13:46:49.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.686+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3f1c06a1a0 con 0x7f3f1c152050 2024-04-25T13:46:49.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.686+0000 7f3f197fa640 1 -- 172.21.15.77:0/3125662601 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f3f1005b940 con 0x7f3f1c152050 2024-04-25T13:46:49.687 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T13:46:49.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3f0806f400 msgr2=0x7f3f08071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3f0806f400 0x7f3f08071910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3f140ae000 tx=0x7f3f140a7070 comp rx=0 tx=0).stop 2024-04-25T13:46:49.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c152050 msgr2=0x7f3f1c1eeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c152050 0x7f3f1c1eeb20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000c340 tx=0x7f3f1000c800 comp rx=0 tx=0).stop 2024-04-25T13:46:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 shutdown_connections 2024-04-25T13:46:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3f0806f400 0x7f3f08071910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3f1c156170 0x7f3f1c148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c152050 0x7f3f1c1eeb20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 --2- 172.21.15.77:0/3125662601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f1c073ba0 0x7f3f1c14d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 >> 172.21.15.77:0/3125662601 conn(0x7f3f1c0a7d80 msgr2=0x7f3f1c149b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 shutdown_connections 2024-04-25T13:46:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.690+0000 7f3f22f3b640 1 -- 172.21.15.77:0/3125662601 wait complete. 2024-04-25T13:46:49.708 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:46:49.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.850+0000 7f9eb14e5640 1 Processor -- start 2024-04-25T13:46:49.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.850+0000 7f9eb14e5640 1 -- start start 2024-04-25T13:46:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.850+0000 7f9eb14e5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9eac0a5580 0x7f9eac06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.850+0000 7f9eb14e5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9eac06ff10 0x7f9eac0a7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 0x7f9eac0a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9eac0a3760 con 0x7f9eac0a5580 2024-04-25T13:46:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f9eac0a8820 con 0x7f9eac06ff10 2024-04-25T13:46:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f9eac153090 con 0x7f9eac0a7ed0 2024-04-25T13:46:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9eac0a5580 0x7f9eac06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9eac0a5580 0x7f9eac06f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37734/0 (socket says 172.21.15.77:37734) 2024-04-25T13:46:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaaffd640 1 -- 172.21.15.77:0/4169570365 learned_addr learned my addr 172.21.15.77:0/4169570365 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9ea3fff640 1 --2- 172.21.15.77:0/4169570365 >> v2:172.21.15.96:3300/0 conn(0x7f9eac06ff10 0x7f9eac0a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eab7fe640 1 --2- 172.21.15.77:0/4169570365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 0x7f9eac0a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaaffd640 1 -- 172.21.15.77:0/4169570365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 msgr2=0x7f9eac0a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaaffd640 1 --2- 172.21.15.77:0/4169570365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 0x7f9eac0a82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaaffd640 1 -- 172.21.15.77:0/4169570365 >> v2:172.21.15.96:3300/0 conn(0x7f9eac06ff10 msgr2=0x7f9eac0a7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaaffd640 1 --2- 172.21.15.77:0/4169570365 >> v2:172.21.15.96:3300/0 conn(0x7f9eac06ff10 0x7f9eac0a7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaaffd640 1 -- 172.21.15.77:0/4169570365 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac1535c0 con 0x7f9eac0a5580 2024-04-25T13:46:49.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaaffd640 1 --2- 172.21.15.77:0/4169570365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac0a5580 0x7f9eac06f9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0c4740 tx=0x7f9e9c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c3b717f3453e5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:49.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaa7fc640 1 -- 172.21.15.77:0/4169570365 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0b1070 con 0x7f9eac0a5580 2024-04-25T13:46:49.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaa7fc640 1 -- 172.21.15.77:0/4169570365 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c0ac630 con 0x7f9eac0a5580 2024-04-25T13:46:49.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eaa7fc640 1 -- 172.21.15.77:0/4169570365 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0a8050 con 0x7f9eac0a5580 2024-04-25T13:46:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 -- 172.21.15.77:0/4169570365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac0a5580 msgr2=0x7f9eac06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/4169570365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac0a5580 0x7f9eac06f9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0c4740 tx=0x7f9e9c01c520 comp rx=0 tx=0).stop 2024-04-25T13:46:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 -- 172.21.15.77:0/4169570365 shutdown_connections 2024-04-25T13:46:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/4169570365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 0x7f9eac0a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/4169570365 >> v2:172.21.15.96:3300/0 conn(0x7f9eac06ff10 0x7f9eac0a7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/4169570365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac0a5580 0x7f9eac06f9d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 -- 172.21.15.77:0/4169570365 >> 172.21.15.77:0/4169570365 conn(0x7f9eac0c3cd0 msgr2=0x7f9eac0c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 -- 172.21.15.77:0/4169570365 shutdown_connections 2024-04-25T13:46:49.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.854+0000 7f9eb14e5640 1 -- 172.21.15.77:0/4169570365 wait complete. 2024-04-25T13:46:49.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 Processor -- start 2024-04-25T13:46:49.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 -- start start 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac06ff10 0x7f9eac146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac0a5580 0x7f9eac14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 0x7f9eac072680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac14f2b0 con 0x7f9eac06ff10 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac14f130 con 0x7f9eac0a5580 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f9eac14f430 con 0x7f9eac0a7ed0 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac06ff10 0x7f9eac146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac06ff10 0x7f9eac146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37748/0 (socket says 172.21.15.77:37748) 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eaaffd640 1 -- 172.21.15.77:0/2133360580 learned_addr learned my addr 172.21.15.77:0/2133360580 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:49.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eab7fe640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 0x7f9eac072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9ea3fff640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac0a5580 0x7f9eac14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eaaffd640 1 -- 172.21.15.77:0/2133360580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 msgr2=0x7f9eac072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eaaffd640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 0x7f9eac072680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eaaffd640 1 -- 172.21.15.77:0/2133360580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac0a5580 msgr2=0x7f9eac14c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eaaffd640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac0a5580 0x7f9eac14c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eaaffd640 1 -- 172.21.15.77:0/2133360580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac071e80 con 0x7f9eac06ff10 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eaaffd640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac06ff10 0x7f9eac146010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c01abd0 tx=0x7f9e9c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9ea37fe640 1 -- 172.21.15.77:0/2133360580 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0b1040 con 0x7f9eac06ff10 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9ea37fe640 1 -- 172.21.15.77:0/2133360580 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c0ba070 con 0x7f9eac06ff10 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9ea37fe640 1 -- 172.21.15.77:0/2133360580 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0a8040 con 0x7f9eac06ff10 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eac072160 con 0x7f9eac06ff10 2024-04-25T13:46:49.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.858+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eac073200 con 0x7f9eac06ff10 2024-04-25T13:46:49.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.862+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eac06a1a0 con 0x7f9eac06ff10 2024-04-25T13:46:49.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.862+0000 7f9ea37fe640 1 -- 172.21.15.77:0/2133360580 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9e9c0b5680 con 0x7f9eac06ff10 2024-04-25T13:46:49.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.862+0000 7f9ea37fe640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f9e8c06f400 0x7f9e8c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:49.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.862+0000 7f9ea3fff640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f9e8c06f400 0x7f9e8c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:49.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.862+0000 7f9ea37fe640 1 -- 172.21.15.77:0/2133360580 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f9e9c129060 con 0x7f9eac06ff10 2024-04-25T13:46:49.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.862+0000 7f9ea3fff640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f9e8c06f400 0x7f9e8c071910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9eac155a50 tx=0x7f9e94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:49.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:49.866+0000 7f9ea37fe640 1 -- 172.21.15.77:0/2133360580 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e9c016110 con 0x7f9eac06ff10 2024-04-25T13:46:50.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.026+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9eac0c0350 con 0x7f9eac06ff10 2024-04-25T13:46:50.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.026+0000 7f9ea37fe640 1 -- 172.21.15.77:0/2133360580 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f9e9c0f5900 con 0x7f9eac06ff10 2024-04-25T13:46:50.028 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-04-25T13:46:50.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f9e8c06f400 msgr2=0x7f9e8c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f9e8c06f400 0x7f9e8c071910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9eac155a50 tx=0x7f9e94008040 comp rx=0 tx=0).stop 2024-04-25T13:46:50.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac06ff10 msgr2=0x7f9eac146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac06ff10 0x7f9eac146010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c01abd0 tx=0x7f9e9c0192c0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 shutdown_connections 2024-04-25T13:46:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f9e8c06f400 0x7f9e8c071910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9eac0a7ed0 0x7f9eac072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac0a5580 0x7f9eac14c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 --2- 172.21.15.77:0/2133360580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9eac06ff10 0x7f9eac146010 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 >> 172.21.15.77:0/2133360580 conn(0x7f9eac0c3cd0 msgr2=0x7f9eac0756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 shutdown_connections 2024-04-25T13:46:50.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.030+0000 7f9eb14e5640 1 -- 172.21.15.77:0/2133360580 wait complete. 2024-04-25T13:46:50.048 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T13:46:50.048 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:46:50.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:46:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af863e640 1 Processor -- start 2024-04-25T13:46:50.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af863e640 1 -- start start 2024-04-25T13:46:50.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af863e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af00b85f0 0x7f6af0146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af863e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6af0073bc0 0x7f6af0073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af863e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af0074510 con 0x7f6af0071900 2024-04-25T13:46:50.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af863e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f6af0071d10 con 0x7f6af0073bc0 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af863e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6af0150ff0 con 0x7f6af00b85f0 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af5bd9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6af0071900 0x7f6af006f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56520/0 (socket says 172.21.15.77:56520) 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af5bd9640 1 -- 172.21.15.77:0/1505623190 learned_addr learned my addr 172.21.15.77:0/1505623190 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af63da640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af00b85f0 0x7f6af0146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af6bdb640 1 --2- 172.21.15.77:0/1505623190 >> v2:172.21.15.96:3300/0 conn(0x7f6af0073bc0 0x7f6af0073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833363288 0 0) 0x7f6af0074510 con 0x7f6af0071900 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6adc003530 con 0x7f6af0071900 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1716241145 0 0) 0x7f6adc003530 con 0x7f6af0071900 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af00b85f0 msgr2=0x7f6af0146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af00b85f0 0x7f6af0146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 >> v2:172.21.15.96:3300/0 conn(0x7f6af0073bc0 msgr2=0x7f6af0073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 --2- 172.21.15.77:0/1505623190 >> v2:172.21.15.96:3300/0 conn(0x7f6af0073bc0 0x7f6af0073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af00733c0 con 0x7f6af0071900 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f6ae0001680 con 0x7f6af0071900 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 >> v1:172.21.15.77:6789/0 conn(0x7f6af0071900 legacy=0x7f6af006f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6adc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6adc004810 0x7f6adc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af00b85f0 0x7f6adc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0071d10 con 0x7f6adc0039c0 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0150ff0 con 0x7f6adc004810 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6adc00ba80 con 0x7f6af00b85f0 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.194+0000 7f6af63da640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6adc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af6bdb640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af00b85f0 0x7f6adc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af5bd9640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6adc004810 0x7f6adc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af63da640 1 -- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af00b85f0 msgr2=0x7f6adc005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af63da640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af00b85f0 0x7f6adc005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af63da640 1 -- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6adc004810 msgr2=0x7f6adc004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:50.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af63da640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6adc004810 0x7f6adc004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af63da640 1 -- 172.21.15.77:0/1505623190 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc003530 con 0x7f6adc0039c0 2024-04-25T13:46:50.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af6bdb640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af00b85f0 0x7f6adc005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:50.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af5bd9640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6adc004810 0x7f6adc004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af63da640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6adc003e30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6af00c1370 tx=0x7f6aec01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4140089620e886e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec009690 con 0x7f6adc0039c0 2024-04-25T13:46:50.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aec0059a0 con 0x7f6adc0039c0 2024-04-25T13:46:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.198+0000 7f6af53d8640 1 -- 172.21.15.77:0/1505623190 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec005d50 con 0x7f6adc0039c0 2024-04-25T13:46:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 -- 172.21.15.77:0/1505623190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 msgr2=0x7f6adc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 --2- 172.21.15.77:0/1505623190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6adc003e30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6af00c1370 tx=0x7f6aec01c9e0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af6bdb640 1 -- 172.21.15.77:0/1505623190 reap_dead start 2024-04-25T13:46:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 -- 172.21.15.77:0/1505623190 shutdown_connections 2024-04-25T13:46:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 -- 172.21.15.77:0/1505623190 >> 172.21.15.77:0/1505623190 conn(0x7f6af00c02a0 msgr2=0x7f6af00c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 -- 172.21.15.77:0/1505623190 shutdown_connections 2024-04-25T13:46:50.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 -- 172.21.15.77:0/1505623190 wait complete. 2024-04-25T13:46:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 Processor -- start 2024-04-25T13:46:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 -- start start 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6af0141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af01ea3a0 0x7f6af013fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af01ea7b0 0x7f6af01400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6af00a7110 con 0x7f6adc0039c0 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6af00a6f90 con 0x7f6af01ea3a0 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af863e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6af00a7290 con 0x7f6af01ea7b0 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af63da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6af0141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af63da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6af0141970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37776/0 (socket says 172.21.15.77:37776) 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af63da640 1 -- 172.21.15.77:0/2829197541 learned_addr learned my addr 172.21.15.77:0/2829197541 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af5bd9640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af01ea3a0 0x7f6af013fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.202+0000 7f6af6bdb640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af01ea7b0 0x7f6af01400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af63da640 1 -- 172.21.15.77:0/2829197541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af01ea7b0 msgr2=0x7f6af01400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af63da640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af01ea7b0 0x7f6af01400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af63da640 1 -- 172.21.15.77:0/2829197541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af01ea3a0 msgr2=0x7f6af013fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af63da640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af01ea3a0 0x7f6af013fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af63da640 1 -- 172.21.15.77:0/2829197541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af0153fa0 con 0x7f6adc0039c0 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af5bd9640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af01ea3a0 0x7f6af013fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af63da640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6af0141970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6aec000c10 tx=0x7f6adc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6ae6ffd640 1 -- 172.21.15.77:0/2829197541 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0bf070 con 0x7f6adc0039c0 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6ae6ffd640 1 -- 172.21.15.77:0/2829197541 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aec006030 con 0x7f6adc0039c0 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af01536a0 con 0x7f6adc0039c0 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6ae6ffd640 1 -- 172.21.15.77:0/2829197541 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec006400 con 0x7f6adc0039c0 2024-04-25T13:46:50.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af01eacf0 con 0x7f6adc0039c0 2024-04-25T13:46:50.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af006a280 con 0x7f6adc0039c0 2024-04-25T13:46:50.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6ae6ffd640 1 -- 172.21.15.77:0/2829197541 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6aec0c2070 con 0x7f6adc0039c0 2024-04-25T13:46:50.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6ae6ffd640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6ad406f400 0x7f6ad4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6ae6ffd640 1 -- 172.21.15.77:0/2829197541 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f6aec129340 con 0x7f6adc0039c0 2024-04-25T13:46:50.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af5bd9640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6ad406f400 0x7f6ad4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.206+0000 7f6af5bd9640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6ad406f400 0x7f6ad4071910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6af0142640 tx=0x7f6ae0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:50.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.210+0000 7f6ae6ffd640 1 -- 172.21.15.77:0/2829197541 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6aec016720 con 0x7f6adc0039c0 2024-04-25T13:46:50.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.362+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6af0144220 con 0x7f6adc0039c0 2024-04-25T13:46:50.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.362+0000 7f6ae6ffd640 1 -- 172.21.15.77:0/2829197541 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16853 (secure 0 0 0) 0x7f6aec0f6310 con 0x7f6adc0039c0 2024-04-25T13:46:50.365 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:46:50.365 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:51.564949+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6ad406f400 msgr2=0x7f6ad4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6ad406f400 0x7f6ad4071910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6af0142640 tx=0x7f6ae0009040 comp rx=0 tx=0).stop 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 msgr2=0x7f6af0141970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6af0141970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6aec000c10 tx=0x7f6adc005840 comp rx=0 tx=0).stop 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 shutdown_connections 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6ad406f400 0x7f6ad4071910 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6af01ea7b0 0x7f6af01400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6af01ea3a0 0x7f6af013fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 --2- 172.21.15.77:0/2829197541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0039c0 0x7f6af0141970 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 >> 172.21.15.77:0/2829197541 conn(0x7f6af00c02a0 msgr2=0x7f6af0073fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:50.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 shutdown_connections 2024-04-25T13:46:50.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.366+0000 7f6af863e640 1 -- 172.21.15.77:0/2829197541 wait complete. 2024-04-25T13:46:50.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:40:58.420007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:41:01.460651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:41:02.746892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:46:50.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:46:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f058d7ac640 1 Processor -- start 2024-04-25T13:46:50.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f058d7ac640 1 -- start start 2024-04-25T13:46:50.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f058d7ac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05880a8bd0 0x7f0588073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f058d7ac640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f058814e710 0x7f058814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f058d7ac640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058814f2a0 con 0x7f058806fa90 2024-04-25T13:46:50.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f058d7ac640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f058814f060 con 0x7f05880a8bd0 2024-04-25T13:46:50.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f058d7ac640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f05881535a0 con 0x7f058814e710 2024-04-25T13:46:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f0586ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05880a8bd0 0x7f0588073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f0586ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05880a8bd0 0x7f0588073bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51766/0 (socket says 172.21.15.77:51766) 2024-04-25T13:46:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f0586ffd640 1 -- 172.21.15.77:0/3878413552 learned_addr learned my addr 172.21.15.77:0/3878413552 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f05877fe640 1 --2- 172.21.15.77:0/3878413552 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f058814e710 0x7f058814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f0586ffd640 1 -- 172.21.15.77:0/3878413552 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f058814e710 msgr2=0x7f058814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f0586ffd640 1 --2- 172.21.15.77:0/3878413552 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f058814e710 0x7f058814eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f0586ffd640 1 -- 172.21.15.77:0/3878413552 >> v1:172.21.15.96:6789/0 conn(0x7f058806fa90 legacy=0x7f058814faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.530+0000 7f0586ffd640 1 -- 172.21.15.77:0/3878413552 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058814f580 con 0x7f05880a8bd0 2024-04-25T13:46:50.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f0586ffd640 1 --2- 172.21.15.77:0/3878413552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880a8bd0 0x7f0588073bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0578009870 tx=0x7f057801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32dfacad2a42b42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:50.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f0585ffb640 1 -- 172.21.15.77:0/3878413552 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05780aa600 con 0x7f05880a8bd0 2024-04-25T13:46:50.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f0585ffb640 1 -- 172.21.15.77:0/3878413552 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05780af070 con 0x7f05880a8bd0 2024-04-25T13:46:50.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f0585ffb640 1 -- 172.21.15.77:0/3878413552 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05780aa9c0 con 0x7f05880a8bd0 2024-04-25T13:46:50.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 -- 172.21.15.77:0/3878413552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880a8bd0 msgr2=0x7f0588073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 --2- 172.21.15.77:0/3878413552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880a8bd0 0x7f0588073bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0578009870 tx=0x7f057801c4c0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 -- 172.21.15.77:0/3878413552 shutdown_connections 2024-04-25T13:46:50.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 --2- 172.21.15.77:0/3878413552 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f058814e710 0x7f058814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 --2- 172.21.15.77:0/3878413552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05880a8bd0 0x7f0588073bf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 -- 172.21.15.77:0/3878413552 >> 172.21.15.77:0/3878413552 conn(0x7f05880c4ae0 msgr2=0x7f05880c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:50.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 -- 172.21.15.77:0/3878413552 shutdown_connections 2024-04-25T13:46:50.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 -- 172.21.15.77:0/3878413552 wait complete. 2024-04-25T13:46:50.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 Processor -- start 2024-04-25T13:46:50.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.534+0000 7f058d7ac640 1 -- start start 2024-04-25T13:46:50.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f058d7ac640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058806fa90 0x7f058814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f058d7ac640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05880a8bd0 0x7f058814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f058d7ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f058814e710 0x7f05881ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f058d7ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0588070020 con 0x7f058814e710 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f058d7ac640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f058806fea0 con 0x7f058806fa90 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f058d7ac640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f058815c220 con 0x7f05880a8bd0 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f058814e710 0x7f05881ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f058814e710 0x7f05881ecb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51772/0 (socket says 172.21.15.77:51772) 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05877fe640 1 -- 172.21.15.77:0/591215142 learned_addr learned my addr 172.21.15.77:0/591215142 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f0586ffd640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058806fa90 0x7f058814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05877fe640 1 -- 172.21.15.77:0/591215142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05880a8bd0 msgr2=0x7f058814b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05867fc640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05880a8bd0 0x7f058814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05877fe640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05880a8bd0 0x7f058814b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05877fe640 1 -- 172.21.15.77:0/591215142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058806fa90 msgr2=0x7f058814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05877fe640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058806fa90 0x7f058814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05877fe640 1 -- 172.21.15.77:0/591215142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05880aaac0 con 0x7f058814e710 2024-04-25T13:46:50.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f05877fe640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f058814e710 0x7f05881ecb10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f058000cc60 tx=0x7f058000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:50.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f056f7fe640 1 -- 172.21.15.77:0/591215142 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05800039a0 con 0x7f058814e710 2024-04-25T13:46:50.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f056f7fe640 1 -- 172.21.15.77:0/591215142 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0580003b40 con 0x7f058814e710 2024-04-25T13:46:50.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05880c2020 con 0x7f058814e710 2024-04-25T13:46:50.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f056f7fe640 1 -- 172.21.15.77:0/591215142 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580004020 con 0x7f058814e710 2024-04-25T13:46:50.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0588157e40 con 0x7f058814e710 2024-04-25T13:46:50.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058806a1a0 con 0x7f058814e710 2024-04-25T13:46:50.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f056f7fe640 1 -- 172.21.15.77:0/591215142 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f05800041c0 con 0x7f058814e710 2024-04-25T13:46:50.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f056f7fe640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f057406f400 0x7f0574071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f0586ffd640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f057406f400 0x7f0574071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.538+0000 7f056f7fe640 1 -- 172.21.15.77:0/591215142 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f058008f720 con 0x7f058814e710 2024-04-25T13:46:50.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.542+0000 7f0586ffd640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f057406f400 0x7f0574071910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f05780ae000 tx=0x7f05780a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:50.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.546+0000 7f056f7fe640 1 -- 172.21.15.77:0/591215142 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0580014030 con 0x7f058814e710 2024-04-25T13:46:50.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.698+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f058806e6d0 con 0x7f058814e710 2024-04-25T13:46:50.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.698+0000 7f056f7fe640 1 -- 172.21.15.77:0/591215142 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f058005c610 con 0x7f058814e710 2024-04-25T13:46:50.699 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.698+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f057406f400 msgr2=0x7f0574071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.698+0000 7f058d7ac640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f057406f400 0x7f0574071910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f05780ae000 tx=0x7f05780a7000 comp rx=0 tx=0).stop 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.698+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f058814e710 msgr2=0x7f05881ecb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.698+0000 7f058d7ac640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f058814e710 0x7f05881ecb10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f058000cc60 tx=0x7f058000a5c0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.702+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 shutdown_connections 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.702+0000 7f058d7ac640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f057406f400 0x7f0574071910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.702+0000 7f058d7ac640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f058814e710 0x7f05881ecb10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.702+0000 7f058d7ac640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05880a8bd0 0x7f058814b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.702+0000 7f058d7ac640 1 --2- 172.21.15.77:0/591215142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f058806fa90 0x7f058814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.702+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 >> 172.21.15.77:0/591215142 conn(0x7f05880c4ae0 msgr2=0x7f058814faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.702+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 shutdown_connections 2024-04-25T13:46:50.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.702+0000 7f058d7ac640 1 -- 172.21.15.77:0/591215142 wait complete. 2024-04-25T13:46:50.718 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:46:50.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe506e32640 1 Processor -- start 2024-04-25T13:46:50.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe506e32640 1 -- start start 2024-04-25T13:46:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe506e32640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe5000a8f80 0x7fe50006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe506e32640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe500073790 0x7fe500073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe506e32640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe500072c80 con 0x7fe500074570 2024-04-25T13:46:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe506e32640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe5000732d0 con 0x7fe5000a8f80 2024-04-25T13:46:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe506e32640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe50006ce30 con 0x7fe500073790 2024-04-25T13:46:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe504bce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe5000a8f80 0x7fe50006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe504bce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe5000a8f80 0x7fe50006c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51778/0 (socket says 172.21.15.77:51778) 2024-04-25T13:46:50.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe504bce640 1 -- 172.21.15.77:0/2989460321 learned_addr learned my addr 172.21.15.77:0/2989460321 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:50.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe5053cf640 1 --2- 172.21.15.77:0/2989460321 >> v2:172.21.15.96:3300/0 conn(0x7fe500073790 0x7fe500073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe504bce640 1 -- 172.21.15.77:0/2989460321 >> v2:172.21.15.96:3300/0 conn(0x7fe500073790 msgr2=0x7fe500073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:50.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe504bce640 1 --2- 172.21.15.77:0/2989460321 >> v2:172.21.15.96:3300/0 conn(0x7fe500073790 0x7fe500073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe504bce640 1 -- 172.21.15.77:0/2989460321 >> v1:172.21.15.96:6789/0 conn(0x7fe500074570 legacy=0x7fe500152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:50.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe504bce640 1 -- 172.21.15.77:0/2989460321 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe500072f60 con 0x7fe5000a8f80 2024-04-25T13:46:50.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.862+0000 7fe5053cf640 1 --2- 172.21.15.77:0/2989460321 >> v2:172.21.15.96:3300/0 conn(0x7fe500073790 0x7fe500073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:50.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe504bce640 1 --2- 172.21.15.77:0/2989460321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 0x7fe50006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe500074e50 tx=0x7fe4f801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44702cb52f76560 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:50.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe4ff7fe640 1 -- 172.21.15.77:0/2989460321 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80a5780 con 0x7fe5000a8f80 2024-04-25T13:46:50.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe4ff7fe640 1 -- 172.21.15.77:0/2989460321 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f80a5920 con 0x7fe5000a8f80 2024-04-25T13:46:50.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe4ff7fe640 1 -- 172.21.15.77:0/2989460321 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80a5cf0 con 0x7fe5000a8f80 2024-04-25T13:46:50.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe506e32640 1 -- 172.21.15.77:0/2989460321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 msgr2=0x7fe50006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe506e32640 1 --2- 172.21.15.77:0/2989460321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 0x7fe50006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe500074e50 tx=0x7fe4f801c9b0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe506e32640 1 -- 172.21.15.77:0/2989460321 shutdown_connections 2024-04-25T13:46:50.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe506e32640 1 --2- 172.21.15.77:0/2989460321 >> v2:172.21.15.96:3300/0 conn(0x7fe500073790 0x7fe500073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe506e32640 1 --2- 172.21.15.77:0/2989460321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 0x7fe50006c8f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe506e32640 1 -- 172.21.15.77:0/2989460321 >> 172.21.15.77:0/2989460321 conn(0x7fe5000c4ae0 msgr2=0x7fe5000c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:50.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe506e32640 1 -- 172.21.15.77:0/2989460321 shutdown_connections 2024-04-25T13:46:50.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.866+0000 7fe506e32640 1 -- 172.21.15.77:0/2989460321 wait complete. 2024-04-25T13:46:50.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 Processor -- start 2024-04-25T13:46:50.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 -- start start 2024-04-25T13:46:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500073790 0x7fe50014c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe500074570 0x7fe5000bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 0x7fe500147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5001535e0 con 0x7fe5000a8f80 2024-04-25T13:46:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe500074330 con 0x7fe500073790 2024-04-25T13:46:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe50015f500 con 0x7fe500074570 2024-04-25T13:46:50.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe5053cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 0x7fe500147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe5053cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 0x7fe500147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51790/0 (socket says 172.21.15.77:51790) 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe5053cf640 1 -- 172.21.15.77:0/3660155297 learned_addr learned my addr 172.21.15.77:0/3660155297 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe504bce640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500073790 0x7fe50014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe4fffff640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe500074570 0x7fe5000bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe5053cf640 1 -- 172.21.15.77:0/3660155297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe500074570 msgr2=0x7fe5000bdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe5053cf640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe500074570 0x7fe5000bdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe5053cf640 1 -- 172.21.15.77:0/3660155297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500073790 msgr2=0x7fe50014c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe5053cf640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500073790 0x7fe50014c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe5053cf640 1 -- 172.21.15.77:0/3660155297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe500146070 con 0x7fe5000a8f80 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe5053cf640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 0x7fe500147cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000c5c0 tx=0x7fe4f000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe4fd7fa640 1 -- 172.21.15.77:0/3660155297 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0015070 con 0x7fe5000a8f80 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe4fd7fa640 1 -- 172.21.15.77:0/3660155297 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f0011820 con 0x7fe5000a8f80 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5000bf510 con 0x7fe5000a8f80 2024-04-25T13:46:50.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe4fd7fa640 1 -- 172.21.15.77:0/3660155297 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0011c10 con 0x7fe5000a8f80 2024-04-25T13:46:50.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe500148230 con 0x7fe5000a8f80 2024-04-25T13:46:50.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.870+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50006a1a0 con 0x7fe5000a8f80 2024-04-25T13:46:50.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.874+0000 7fe4fd7fa640 1 -- 172.21.15.77:0/3660155297 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe4f0018070 con 0x7fe5000a8f80 2024-04-25T13:46:50.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.874+0000 7fe4fd7fa640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe4ec06f400 0x7fe4ec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:50.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.874+0000 7fe504bce640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe4ec06f400 0x7fe4ec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:50.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.874+0000 7fe4fd7fa640 1 -- 172.21.15.77:0/3660155297 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe4f008f130 con 0x7fe5000a8f80 2024-04-25T13:46:50.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.874+0000 7fe504bce640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe4ec06f400 0x7fe4ec071910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80ae000 tx=0x7fe4f80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:50.878+0000 7fe4fd7fa640 1 -- 172.21.15.77:0/3660155297 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4f005c020 con 0x7fe5000a8f80 2024-04-25T13:46:51.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.026+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe500149320 con 0x7fe5000a8f80 2024-04-25T13:46:51.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.026+0000 7fe4fd7fa640 1 -- 172.21.15.77:0/3660155297 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fe4f005b920 con 0x7fe5000a8f80 2024-04-25T13:46:51.027 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T13:46:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe4ec06f400 msgr2=0x7fe4ec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe4ec06f400 0x7fe4ec071910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80ae000 tx=0x7fe4f80a7070 comp rx=0 tx=0).stop 2024-04-25T13:46:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 msgr2=0x7fe500147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 0x7fe500147cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000c5c0 tx=0x7fe4f000ca80 comp rx=0 tx=0).stop 2024-04-25T13:46:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 shutdown_connections 2024-04-25T13:46:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe4ec06f400 0x7fe4ec071910 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5000a8f80 0x7fe500147cf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe500074570 0x7fe5000bdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 --2- 172.21.15.77:0/3660155297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe500073790 0x7fe50014c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 >> 172.21.15.77:0/3660155297 conn(0x7fe5000c4ae0 msgr2=0x7fe50014c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 shutdown_connections 2024-04-25T13:46:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.030+0000 7fe506e32640 1 -- 172.21.15.77:0/3660155297 wait complete. 2024-04-25T13:46:51.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:46:51.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd4464e640 1 Processor -- start 2024-04-25T13:46:51.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd4464e640 1 -- start start 2024-04-25T13:46:51.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd4464e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd3c14d350 0x7efd3c14d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd4464e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efd3c1502c0 0x7efd3c1506d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd4464e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd3c0aadb0 con 0x7efd3c074690 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd4464e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efd3c154530 con 0x7efd3c14d350 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd4464e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7efd3c0aa880 con 0x7efd3c1502c0 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd41be9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd3c14d350 0x7efd3c14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd41be9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd3c14d350 0x7efd3c14d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51806/0 (socket says 172.21.15.77:51806) 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd41be9640 1 -- 172.21.15.77:0/1299222872 learned_addr learned my addr 172.21.15.77:0/1299222872 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd42beb640 1 --2- 172.21.15.77:0/1299222872 >> v2:172.21.15.96:3300/0 conn(0x7efd3c1502c0 0x7efd3c1506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd41be9640 1 -- 172.21.15.77:0/1299222872 >> v2:172.21.15.96:3300/0 conn(0x7efd3c1502c0 msgr2=0x7efd3c1506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd41be9640 1 --2- 172.21.15.77:0/1299222872 >> v2:172.21.15.96:3300/0 conn(0x7efd3c1502c0 0x7efd3c1506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd41be9640 1 -- 172.21.15.77:0/1299222872 >> v1:172.21.15.96:6789/0 conn(0x7efd3c074690 legacy=0x7efd3c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.194+0000 7efd41be9640 1 -- 172.21.15.77:0/1299222872 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3c0aaad0 con 0x7efd3c14d350 2024-04-25T13:46:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd41be9640 1 --2- 172.21.15.77:0/1299222872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c14d350 0x7efd3c14d760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0ab190 tx=0x7efd2c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d802b8afd560d46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd413e8640 1 -- 172.21.15.77:0/1299222872 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c0b2070 con 0x7efd3c14d350 2024-04-25T13:46:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd413e8640 1 -- 172.21.15.77:0/1299222872 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd2c0ad680 con 0x7efd3c14d350 2024-04-25T13:46:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd413e8640 1 -- 172.21.15.77:0/1299222872 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c0ada50 con 0x7efd3c14d350 2024-04-25T13:46:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd4464e640 1 -- 172.21.15.77:0/1299222872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c14d350 msgr2=0x7efd3c14d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd4464e640 1 --2- 172.21.15.77:0/1299222872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c14d350 0x7efd3c14d760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0ab190 tx=0x7efd2c01c470 comp rx=0 tx=0).stop 2024-04-25T13:46:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd4464e640 1 -- 172.21.15.77:0/1299222872 shutdown_connections 2024-04-25T13:46:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd4464e640 1 --2- 172.21.15.77:0/1299222872 >> v2:172.21.15.96:3300/0 conn(0x7efd3c1502c0 0x7efd3c1506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd4464e640 1 --2- 172.21.15.77:0/1299222872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c14d350 0x7efd3c14d760 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd4464e640 1 -- 172.21.15.77:0/1299222872 >> 172.21.15.77:0/1299222872 conn(0x7efd3c0a7d80 msgr2=0x7efd3c0c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd4464e640 1 -- 172.21.15.77:0/1299222872 shutdown_connections 2024-04-25T13:46:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd4464e640 1 -- 172.21.15.77:0/1299222872 wait complete. 2024-04-25T13:46:51.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.198+0000 7efd4464e640 1 Processor -- start 2024-04-25T13:46:51.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 -- start start 2024-04-25T13:46:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd3c074690 0x7efd3c1edef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd3c14d350 0x7efd3c14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c1502c0 0x7efd3c1ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c15d7f0 con 0x7efd3c1502c0 2024-04-25T13:46:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c15d670 con 0x7efd3c14d350 2024-04-25T13:46:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7efd3c15d970 con 0x7efd3c074690 2024-04-25T13:46:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd42beb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c1502c0 0x7efd3c1ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd42beb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c1502c0 0x7efd3c1ed530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51820/0 (socket says 172.21.15.77:51820) 2024-04-25T13:46:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd42beb640 1 -- 172.21.15.77:0/2721043213 learned_addr learned my addr 172.21.15.77:0/2721043213 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd423ea640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd3c074690 0x7efd3c1edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd41be9640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd3c14d350 0x7efd3c14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd42beb640 1 -- 172.21.15.77:0/2721043213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd3c074690 msgr2=0x7efd3c1edef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd42beb640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd3c074690 0x7efd3c1edef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd42beb640 1 -- 172.21.15.77:0/2721043213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd3c14d350 msgr2=0x7efd3c14dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd42beb640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd3c14d350 0x7efd3c14dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd42beb640 1 -- 172.21.15.77:0/2721043213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3c145760 con 0x7efd3c1502c0 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd41be9640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd3c14d350 0x7efd3c14dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd42beb640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c1502c0 0x7efd3c1ed530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efd3400efc0 tx=0x7efd3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd32ffd640 1 -- 172.21.15.77:0/2721043213 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34018020 con 0x7efd3c1502c0 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd32ffd640 1 -- 172.21.15.77:0/2721043213 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd34014480 con 0x7efd3c1502c0 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3c145a40 con 0x7efd3c1502c0 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd32ffd640 1 -- 172.21.15.77:0/2721043213 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34009e60 con 0x7efd3c1502c0 2024-04-25T13:46:51.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd3c14e420 con 0x7efd3c1502c0 2024-04-25T13:46:51.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd3c14e650 con 0x7efd3c1502c0 2024-04-25T13:46:51.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.202+0000 7efd32ffd640 1 -- 172.21.15.77:0/2721043213 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efd3401b020 con 0x7efd3c1502c0 2024-04-25T13:46:51.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.206+0000 7efd32ffd640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd2006f400 0x7efd20071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.206+0000 7efd32ffd640 1 -- 172.21.15.77:0/2721043213 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7efd340901c0 con 0x7efd3c1502c0 2024-04-25T13:46:51.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.206+0000 7efd423ea640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd2006f400 0x7efd20071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.206+0000 7efd423ea640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd2006f400 0x7efd20071910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd38000f70 tx=0x7efd38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:51.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.210+0000 7efd32ffd640 1 -- 172.21.15.77:0/2721043213 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd3c14e650 con 0x7efd3c1502c0 2024-04-25T13:46:51.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.374+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efd3c06a1a0 con 0x7efd3c1502c0 2024-04-25T13:46:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.374+0000 7efd32ffd640 1 -- 172.21.15.77:0/2721043213 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7efd34022020 con 0x7efd3c1502c0 2024-04-25T13:46:51.375 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T13:46:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd2006f400 msgr2=0x7efd20071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd2006f400 0x7efd20071910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd38000f70 tx=0x7efd38009040 comp rx=0 tx=0).stop 2024-04-25T13:46:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c1502c0 msgr2=0x7efd3c1ed530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c1502c0 0x7efd3c1ed530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efd3400efc0 tx=0x7efd3400c490 comp rx=0 tx=0).stop 2024-04-25T13:46:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 shutdown_connections 2024-04-25T13:46:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7efd2006f400 0x7efd20071910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd3c1502c0 0x7efd3c1ed530 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd3c14d350 0x7efd3c14dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 --2- 172.21.15.77:0/2721043213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd3c074690 0x7efd3c1edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 >> 172.21.15.77:0/2721043213 conn(0x7efd3c0a7d80 msgr2=0x7efd3c0c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:51.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 shutdown_connections 2024-04-25T13:46:51.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.378+0000 7efd4464e640 1 -- 172.21.15.77:0/2721043213 wait complete. 2024-04-25T13:46:51.396 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:46:51.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1b4cbd640 1 Processor -- start 2024-04-25T13:46:51.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1b4cbd640 1 -- start start 2024-04-25T13:46:51.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1b4cbd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1b014fe10 0x7fb1b0072e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1b4cbd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb1b00733d0 0x7fb1b00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1b4cbd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1b00741b0 con 0x7fb1b006fba0 2024-04-25T13:46:51.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1b4cbd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb1b0071b10 con 0x7fb1b014fe10 2024-04-25T13:46:51.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1b4cbd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb1b00bfe40 con 0x7fb1b00733d0 2024-04-25T13:46:51.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1add9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1b014fe10 0x7fb1b0072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1add9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1b014fe10 0x7fb1b0072e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51824/0 (socket says 172.21.15.77:51824) 2024-04-25T13:46:51.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1add9b640 1 -- 172.21.15.77:0/1131295701 learned_addr learned my addr 172.21.15.77:0/1131295701 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:51.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1ae59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb1b006fba0 0x7fb1b014f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51690/0 (socket says 172.21.15.77:51690) 2024-04-25T13:46:51.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1add9b640 1 -- 172.21.15.77:0/1131295701 >> v2:172.21.15.96:3300/0 conn(0x7fb1b00733d0 msgr2=0x7fb1b00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:51.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1add9b640 1 --2- 172.21.15.77:0/1131295701 >> v2:172.21.15.96:3300/0 conn(0x7fb1b00733d0 0x7fb1b00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1add9b640 1 -- 172.21.15.77:0/1131295701 >> v1:172.21.15.77:6789/0 conn(0x7fb1b006fba0 legacy=0x7fb1b014f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.538+0000 7fb1add9b640 1 -- 172.21.15.77:0/1131295701 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b0073d20 con 0x7fb1b014fe10 2024-04-25T13:46:51.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1add9b640 1 --2- 172.21.15.77:0/1131295701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 0x7fb1b0072e90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00a6290 tx=0x7fb1a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7bcda6c006fbb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:51.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1ad59a640 1 -- 172.21.15.77:0/1131295701 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40b0070 con 0x7fb1b014fe10 2024-04-25T13:46:51.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1ad59a640 1 -- 172.21.15.77:0/1131295701 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a40ab600 con 0x7fb1b014fe10 2024-04-25T13:46:51.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1ad59a640 1 -- 172.21.15.77:0/1131295701 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40ab9d0 con 0x7fb1b014fe10 2024-04-25T13:46:51.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/1131295701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 msgr2=0x7fb1b0072e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 --2- 172.21.15.77:0/1131295701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 0x7fb1b0072e90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00a6290 tx=0x7fb1a401c490 comp rx=0 tx=0).stop 2024-04-25T13:46:51.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/1131295701 shutdown_connections 2024-04-25T13:46:51.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 --2- 172.21.15.77:0/1131295701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 0x7fb1b0072e90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 --2- 172.21.15.77:0/1131295701 >> v2:172.21.15.96:3300/0 conn(0x7fb1b00733d0 0x7fb1b00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/1131295701 >> 172.21.15.77:0/1131295701 conn(0x7fb1b00c3cd0 msgr2=0x7fb1b00c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:51.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/1131295701 shutdown_connections 2024-04-25T13:46:51.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/1131295701 wait complete. 2024-04-25T13:46:51.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 Processor -- start 2024-04-25T13:46:51.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.542+0000 7fb1b4cbd640 1 -- start start 2024-04-25T13:46:51.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1b4cbd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1b006fba0 0x7fb1b0146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1b4cbd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb1b00733d0 0x7fb1b01ea820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1b4cbd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 0x7fb1b00a7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1b4cbd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b00a8cc0 con 0x7fb1b014fe10 2024-04-25T13:46:51.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1b4cbd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b015d630 con 0x7fb1b006fba0 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1b4cbd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b015d7b0 con 0x7fb1b00733d0 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1aed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 0x7fb1b00a7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1aed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 0x7fb1b00a7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51832/0 (socket says 172.21.15.77:51832) 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1aed9d640 1 -- 172.21.15.77:0/205960341 learned_addr learned my addr 172.21.15.77:0/205960341 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1add9b640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb1b00733d0 0x7fb1b01ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1aed9d640 1 -- 172.21.15.77:0/205960341 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb1b00733d0 msgr2=0x7fb1b01ea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1aed9d640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb1b00733d0 0x7fb1b01ea820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1ae59c640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1b006fba0 0x7fb1b0146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1aed9d640 1 -- 172.21.15.77:0/205960341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1b006fba0 msgr2=0x7fb1b0146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1aed9d640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1b006fba0 0x7fb1b0146940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1aed9d640 1 -- 172.21.15.77:0/205960341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b01e9d80 con 0x7fb1b014fe10 2024-04-25T13:46:51.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1aed9d640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 0x7fb1b00a7b70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800b9e0 tx=0x7fb1a800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:51.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb19effd640 1 -- 172.21.15.77:0/205960341 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8019070 con 0x7fb1b014fe10 2024-04-25T13:46:51.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb19effd640 1 -- 172.21.15.77:0/205960341 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a800cb40 con 0x7fb1b014fe10 2024-04-25T13:46:51.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b01ea040 con 0x7fb1b014fe10 2024-04-25T13:46:51.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb19effd640 1 -- 172.21.15.77:0/205960341 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8014440 con 0x7fb1b014fe10 2024-04-25T13:46:51.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b0146e80 con 0x7fb1b014fe10 2024-04-25T13:46:51.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b006a1a0 con 0x7fb1b014fe10 2024-04-25T13:46:51.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb19effd640 1 -- 172.21.15.77:0/205960341 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb1a801c070 con 0x7fb1b014fe10 2024-04-25T13:46:51.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb19effd640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb19006f400 0x7fb190071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:51.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb19effd640 1 -- 172.21.15.77:0/205960341 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fb1a808efc0 con 0x7fb1b014fe10 2024-04-25T13:46:51.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.546+0000 7fb1ae59c640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb19006f400 0x7fb190071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:51.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.550+0000 7fb1ae59c640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb19006f400 0x7fb190071910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000f70 tx=0x7fb1a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:51.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.554+0000 7fb19effd640 1 -- 172.21.15.77:0/205960341 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb1a805beb0 con 0x7fb1b014fe10 2024-04-25T13:46:51.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1b01497a0 con 0x7fb1b014fe10 2024-04-25T13:46:51.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb19effd640 1 -- 172.21.15.77:0/205960341 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fb1a805b7b0 con 0x7fb1b014fe10 2024-04-25T13:46:51.714 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-04-25T13:46:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb19006f400 msgr2=0x7fb190071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb19006f400 0x7fb190071910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000f70 tx=0x7fb1a0009040 comp rx=0 tx=0).stop 2024-04-25T13:46:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 msgr2=0x7fb1b00a7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 0x7fb1b00a7b70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800b9e0 tx=0x7fb1a800bea0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 shutdown_connections 2024-04-25T13:46:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fb19006f400 0x7fb190071910 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b014fe10 0x7fb1b00a7b70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb1b00733d0 0x7fb1b01ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 --2- 172.21.15.77:0/205960341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1b006fba0 0x7fb1b0146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:51.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 >> 172.21.15.77:0/205960341 conn(0x7fb1b00c3cd0 msgr2=0x7fb1b00c1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:51.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 shutdown_connections 2024-04-25T13:46:51.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:51.714+0000 7fb1b4cbd640 1 -- 172.21.15.77:0/205960341 wait complete. 2024-04-25T13:46:51.733 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi151.front.sepia.ceph.com... 2024-04-25T13:46:51.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:46:51.734 DEBUG:teuthology.orchestra.run.smithi151:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-25T13:46:51.837 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:ceph-fuse[22883]: fuse finished with error 0 and tester_r 0 2024-04-25T13:46:51.839 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:46:57.940 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T13:46:57.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:46:57.941 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T13:46:57.948 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:46:57.948 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:46:57.955 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:46:57.955 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:46:58.002 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:46:58.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce67a10640 1 Processor -- start 2024-04-25T13:46:58.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce67a10640 1 -- start start 2024-04-25T13:46:58.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce67a10640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fce60070b50 0x7fce600c0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce67a10640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce60070f60 con 0x7fce60073d50 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce67a10640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce600a6dc0 con 0x7fce60071490 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce67a10640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fce601535c0 con 0x7fce60070b50 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce64fab640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fce60073d50 0x7fce60152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51704/0 (socket says 172.21.15.77:51704) 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce64fab640 1 -- 172.21.15.77:0/2727716619 learned_addr learned my addr 172.21.15.77:0/2727716619 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce657ac640 1 --2- 172.21.15.77:0/2727716619 >> v2:172.21.15.96:3300/0 conn(0x7fce60070b50 0x7fce600c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505261881 0 0) 0x7fce50001120 con 0x7fce60073d50 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce4c003530 con 0x7fce60073d50 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 822947400 0 0) 0x7fce4c003530 con 0x7fce60073d50 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 >> v2:172.21.15.96:3300/0 conn(0x7fce60070b50 msgr2=0x7fce600c0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 --2- 172.21.15.77:0/2727716619 >> v2:172.21.15.96:3300/0 conn(0x7fce60070b50 0x7fce600c0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 >> v1:172.21.15.96:6789/0 conn(0x7fce60071490 legacy=0x7fce60151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce600a7060 con 0x7fce60073d50 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fce50001850 con 0x7fce60073d50 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 >> v1:172.21.15.77:6789/0 conn(0x7fce60073d50 legacy=0x7fce60152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce4c0039c0 0x7fce4c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce4c004810 0x7fce4c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce4c0051d0 0x7fce4c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce601535c0 con 0x7fce4c004810 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c00c170 con 0x7fce4c0051d0 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fce4c00c370 con 0x7fce4c0039c0 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.162+0000 7fce64fab640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce4c004810 0x7fce4c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce657ac640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce4c0039c0 0x7fce4c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce64fab640 1 -- 172.21.15.77:0/2727716619 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce4c0039c0 msgr2=0x7fce4c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce64fab640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce4c0039c0 0x7fce4c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce65fad640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce4c0051d0 0x7fce4c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce64fab640 1 -- 172.21.15.77:0/2727716619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce4c0051d0 msgr2=0x7fce4c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce64fab640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce4c0051d0 0x7fce4c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce65fad640 1 -- 172.21.15.77:0/2727716619 reap_dead start 2024-04-25T13:46:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce64fab640 1 -- 172.21.15.77:0/2727716619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c003530 con 0x7fce4c004810 2024-04-25T13:46:58.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce657ac640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce4c0039c0 0x7fce4c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce64fab640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce4c004810 0x7fce4c004c20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c490 tx=0x7fce5001f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7face7026232d96e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5000c0e0 con 0x7fce4c004810 2024-04-25T13:46:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce50005b00 con 0x7fce4c004810 2024-04-25T13:46:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce57fff640 1 -- 172.21.15.77:0/2727716619 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce50007070 con 0x7fce4c004810 2024-04-25T13:46:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce67a10640 1 -- 172.21.15.77:0/2727716619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce4c004810 msgr2=0x7fce4c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce67a10640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce4c004810 0x7fce4c004c20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c490 tx=0x7fce5001f3c0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce67a10640 1 -- 172.21.15.77:0/2727716619 shutdown_connections 2024-04-25T13:46:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce67a10640 1 --2- 172.21.15.77:0/2727716619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce4c004810 0x7fce4c004c20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce67a10640 1 -- 172.21.15.77:0/2727716619 >> 172.21.15.77:0/2727716619 conn(0x7fce600a75e0 msgr2=0x7fce600a7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce67a10640 1 -- 172.21.15.77:0/2727716619 shutdown_connections 2024-04-25T13:46:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.166+0000 7fce67a10640 1 -- 172.21.15.77:0/2727716619 wait complete. 2024-04-25T13:46:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 Processor -- start 2024-04-25T13:46:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 -- start start 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce4c004810 0x7fce6014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce601e8550 0x7fce6014e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce60145ab0 0x7fce60145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce60074160 con 0x7fce60145ab0 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fce6006ee70 con 0x7fce4c004810 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fce600742e0 con 0x7fce601e8550 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce65fad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce60145ab0 0x7fce60145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce65fad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce60145ab0 0x7fce60145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51848/0 (socket says 172.21.15.77:51848) 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce65fad640 1 -- 172.21.15.77:0/2529235766 learned_addr learned my addr 172.21.15.77:0/2529235766 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce657ac640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce4c004810 0x7fce6014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce64fab640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce601e8550 0x7fce6014e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce65fad640 1 -- 172.21.15.77:0/2529235766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce601e8550 msgr2=0x7fce6014e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce65fad640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce601e8550 0x7fce6014e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce65fad640 1 -- 172.21.15.77:0/2529235766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce4c004810 msgr2=0x7fce6014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce65fad640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce4c004810 0x7fce6014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce65fad640 1 -- 172.21.15.77:0/2529235766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce60146a50 con 0x7fce60145ab0 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce65fad640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce60145ab0 0x7fce60145ec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce60072260 tx=0x7fce5800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce55ffb640 1 -- 172.21.15.77:0/2529235766 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58003b80 con 0x7fce60145ab0 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce55ffb640 1 -- 172.21.15.77:0/2529235766 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce58017070 con 0x7fce60145ab0 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce60146770 con 0x7fce60145ab0 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce55ffb640 1 -- 172.21.15.77:0/2529235766 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58005070 con 0x7fce60145ab0 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.170+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6014c460 con 0x7fce60145ab0 2024-04-25T13:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.174+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce60146fc0 con 0x7fce60145ab0 2024-04-25T13:46:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.174+0000 7fce55ffb640 1 -- 172.21.15.77:0/2529235766 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fce58005210 con 0x7fce60145ab0 2024-04-25T13:46:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.174+0000 7fce55ffb640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fce4406f400 0x7fce44071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.174+0000 7fce55ffb640 1 -- 172.21.15.77:0/2529235766 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fce5808f060 con 0x7fce60145ab0 2024-04-25T13:46:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.174+0000 7fce657ac640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fce4406f400 0x7fce44071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.174+0000 7fce657ac640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fce4406f400 0x7fce44071910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fce600520f0 tx=0x7fce5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:58.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.178+0000 7fce55ffb640 1 -- 172.21.15.77:0/2529235766 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce5805bf50 con 0x7fce60145ab0 2024-04-25T13:46:58.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.338+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce6006a280 con 0x7fce60145ab0 2024-04-25T13:46:58.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce55ffb640 1 -- 172.21.15.77:0/2529235766 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16853 (secure 0 0 0) 0x7fce5805b850 con 0x7fce60145ab0 2024-04-25T13:46:58.342 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:46:58.342 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:51.564949+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:46:58.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fce4406f400 msgr2=0x7fce44071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fce4406f400 0x7fce44071910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fce600520f0 tx=0x7fce5c008040 comp rx=0 tx=0).stop 2024-04-25T13:46:58.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce60145ab0 msgr2=0x7fce60145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce60145ab0 0x7fce60145ec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce60072260 tx=0x7fce5800dc00 comp rx=0 tx=0).stop 2024-04-25T13:46:58.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 shutdown_connections 2024-04-25T13:46:58.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fce4406f400 0x7fce44071910 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce60145ab0 0x7fce60145ec0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fce601e8550 0x7fce6014e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 --2- 172.21.15.77:0/2529235766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce4c004810 0x7fce6014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 >> 172.21.15.77:0/2529235766 conn(0x7fce600a75e0 msgr2=0x7fce60151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:58.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 shutdown_connections 2024-04-25T13:46:58.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.342+0000 7fce67a10640 1 -- 172.21.15.77:0/2529235766 wait complete. 2024-04-25T13:46:58.362 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:40:58.420007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:41:01.460651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:41:02.746892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:46:58.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:46:58.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b375f640 1 Processor -- start 2024-04-25T13:46:58.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b375f640 1 -- start start 2024-04-25T13:46:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b375f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac152970 0x7f72ac0c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b375f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72ac0a4b10 con 0x7f72ac0bf910 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b375f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72ac0a4df0 con 0x7f72ac14e8a0 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b375f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f72ac0a50d0 con 0x7f72ac152970 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b14fb640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f72ac0bf910 0x7f72ac14f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51718/0 (socket says 172.21.15.77:51718) 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b14fb640 1 -- 172.21.15.77:0/1141657628 learned_addr learned my addr 172.21.15.77:0/1141657628 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b1cfc640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac152970 0x7f72ac0c0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905103718 0 0) 0x7f72ac0a4b10 con 0x7f72ac0bf910 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7298003530 con 0x7f72ac0bf910 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3652112164 0 0) 0x7f7298003530 con 0x7f72ac0bf910 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac152970 msgr2=0x7f72ac0c0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac152970 0x7f72ac0c0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 >> v1:172.21.15.96:6789/0 conn(0x7f72ac14e8a0 legacy=0x7f72ac152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ac0a2fb0 con 0x7f72ac0bf910 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f72a8001680 con 0x7f72ac0bf910 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 >> v1:172.21.15.77:6789/0 conn(0x7f72ac0bf910 legacy=0x7f72ac14f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac152970 0x7f7298003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7298003fe0 0x7f7298004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298004d50 0x7f72980051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac0a50d0 con 0x7f7298003fe0 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f729800bbe0 con 0x7f7298004d50 2024-04-25T13:46:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f729800dff0 con 0x7f72ac152970 2024-04-25T13:46:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b0cfa640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7298003fe0 0x7f7298004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b14fb640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac152970 0x7f7298003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b1cfc640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298004d50 0x7f72980051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b0cfa640 1 -- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac152970 msgr2=0x7f7298003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b0cfa640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac152970 0x7f7298003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b0cfa640 1 -- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298004d50 msgr2=0x7f72980051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b0cfa640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298004d50 0x7f72980051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.518+0000 7f72b0cfa640 1 -- 172.21.15.77:0/1141657628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7298003530 con 0x7f7298003fe0 2024-04-25T13:46:58.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72b0cfa640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7298003fe0 0x7f7298004810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f72ac06e010 tx=0x7f729c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f772522307177712 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c0013a0 con 0x7f7298003fe0 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729c0052f0 con 0x7f7298003fe0 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72a3fff640 1 -- 172.21.15.77:0/1141657628 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c003840 con 0x7f7298003fe0 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72b375f640 1 -- 172.21.15.77:0/1141657628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7298003fe0 msgr2=0x7f7298004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72b375f640 1 --2- 172.21.15.77:0/1141657628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7298003fe0 0x7f7298004810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f72ac06e010 tx=0x7f729c01c3c0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72b1cfc640 1 -- 172.21.15.77:0/1141657628 reap_dead start 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72b375f640 1 -- 172.21.15.77:0/1141657628 shutdown_connections 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72b375f640 1 -- 172.21.15.77:0/1141657628 >> 172.21.15.77:0/1141657628 conn(0x7f72ac0c3cd0 msgr2=0x7f72ac0c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72b375f640 1 -- 172.21.15.77:0/1141657628 shutdown_connections 2024-04-25T13:46:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.522+0000 7f72b375f640 1 -- 172.21.15.77:0/1141657628 wait complete. 2024-04-25T13:46:58.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 Processor -- start 2024-04-25T13:46:58.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 -- start start 2024-04-25T13:46:58.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298003fe0 0x7f72ac09c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72ac14add0 0x7f72ac14b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac1e4240 0x7f72ac1e4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac152d80 con 0x7f72ac14add0 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac14ecb0 con 0x7f7298003fe0 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f72ac0c0b70 con 0x7f72ac1e4240 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b0cfa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72ac14add0 0x7f72ac14b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b0cfa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72ac14add0 0x7f72ac14b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51866/0 (socket says 172.21.15.77:51866) 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b0cfa640 1 -- 172.21.15.77:0/2712020342 learned_addr learned my addr 172.21.15.77:0/2712020342 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b1cfc640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac1e4240 0x7f72ac1e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b14fb640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298003fe0 0x7f72ac09c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b0cfa640 1 -- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac1e4240 msgr2=0x7f72ac1e4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b0cfa640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac1e4240 0x7f72ac1e4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b0cfa640 1 -- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298003fe0 msgr2=0x7f72ac09c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b0cfa640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298003fe0 0x7f72ac09c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b0cfa640 1 -- 172.21.15.77:0/2712020342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ac14e380 con 0x7f72ac14add0 2024-04-25T13:46:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b14fb640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298003fe0 0x7f72ac09c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b1cfc640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac1e4240 0x7f72ac1e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b0cfa640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72ac14add0 0x7f72ac14b1e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f729c01c8a0 tx=0x7f7298005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72a1ffb640 1 -- 172.21.15.77:0/2712020342 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c007a40 con 0x7f72ac14add0 2024-04-25T13:46:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72a1ffb640 1 -- 172.21.15.77:0/2712020342 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729c0bb070 con 0x7f72ac14add0 2024-04-25T13:46:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72a1ffb640 1 -- 172.21.15.77:0/2712020342 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c0013a0 con 0x7f72ac14add0 2024-04-25T13:46:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ac0746c0 con 0x7f72ac14add0 2024-04-25T13:46:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.526+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ac0c05a0 con 0x7f72ac14add0 2024-04-25T13:46:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.530+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ac06a1a0 con 0x7f72ac14add0 2024-04-25T13:46:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.530+0000 7f72a1ffb640 1 -- 172.21.15.77:0/2712020342 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f729c0b4040 con 0x7f72ac14add0 2024-04-25T13:46:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.530+0000 7f72a1ffb640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f729006f430 0x7f7290071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.530+0000 7f72b14fb640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f729006f430 0x7f7290071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.530+0000 7f72a1ffb640 1 -- 172.21.15.77:0/2712020342 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f729c129370 con 0x7f72ac14add0 2024-04-25T13:46:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.530+0000 7f72b14fb640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f729006f430 0x7f7290071940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72a8001060 tx=0x7f72a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:58.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.534+0000 7f72a1ffb640 1 -- 172.21.15.77:0/2712020342 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f729c0160d0 con 0x7f72ac14add0 2024-04-25T13:46:58.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.698+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f72ac09c5f0 con 0x7f72ac14add0 2024-04-25T13:46:58.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.698+0000 7f72a1ffb640 1 -- 172.21.15.77:0/2712020342 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f729c0f6260 con 0x7f72ac14add0 2024-04-25T13:46:58.699 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T13:46:58.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f729006f430 msgr2=0x7f7290071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f729006f430 0x7f7290071940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72a8001060 tx=0x7f72a8009040 comp rx=0 tx=0).stop 2024-04-25T13:46:58.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72ac14add0 msgr2=0x7f72ac14b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72ac14add0 0x7f72ac14b1e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f729c01c8a0 tx=0x7f7298005840 comp rx=0 tx=0).stop 2024-04-25T13:46:58.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 shutdown_connections 2024-04-25T13:46:58.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f729006f430 0x7f7290071940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72ac1e4240 0x7f72ac1e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72ac14add0 0x7f72ac14b1e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 --2- 172.21.15.77:0/2712020342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7298003fe0 0x7f72ac09c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 >> 172.21.15.77:0/2712020342 conn(0x7f72ac0c3cd0 msgr2=0x7f72ac0756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:58.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 shutdown_connections 2024-04-25T13:46:58.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.702+0000 7f72b375f640 1 -- 172.21.15.77:0/2712020342 wait complete. 2024-04-25T13:46:58.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:46:58.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc3af93640 1 Processor -- start 2024-04-25T13:46:58.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc3af93640 1 -- start start 2024-04-25T13:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc3af93640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc340c6840 0x7fbc34153400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc3af93640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc3406dae0 0x7fbc340c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc3af93640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc34152920 con 0x7fbc340c23a0 2024-04-25T13:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc3af93640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbc34152c00 con 0x7fbc3406dae0 2024-04-25T13:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc3af93640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fbc34152ee0 con 0x7fbc340c6840 2024-04-25T13:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc33fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc3406dae0 0x7fbc340c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc33fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc3406dae0 0x7fbc340c1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51874/0 (socket says 172.21.15.77:51874) 2024-04-25T13:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc33fff640 1 -- 172.21.15.77:0/739195729 learned_addr learned my addr 172.21.15.77:0/739195729 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc38d2f640 1 --2- 172.21.15.77:0/739195729 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc340c6840 0x7fbc34153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc33fff640 1 -- 172.21.15.77:0/739195729 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc340c6840 msgr2=0x7fbc34153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc33fff640 1 --2- 172.21.15.77:0/739195729 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc340c6840 0x7fbc34153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc33fff640 1 -- 172.21.15.77:0/739195729 >> v1:172.21.15.96:6789/0 conn(0x7fbc340c23a0 legacy=0x7fbc340c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.870+0000 7fbc33fff640 1 -- 172.21.15.77:0/739195729 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc340c27b0 con 0x7fbc3406dae0 2024-04-25T13:46:58.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc33fff640 1 --2- 172.21.15.77:0/739195729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc3406dae0 0x7fbc340c1e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009870 tx=0x7fbc2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bb18be83bf4fa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:58.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc337fe640 1 -- 172.21.15.77:0/739195729 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc240b0070 con 0x7fbc3406dae0 2024-04-25T13:46:58.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc337fe640 1 -- 172.21.15.77:0/739195729 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc240ab600 con 0x7fbc3406dae0 2024-04-25T13:46:58.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc337fe640 1 -- 172.21.15.77:0/739195729 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc240ab9d0 con 0x7fbc3406dae0 2024-04-25T13:46:58.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc3af93640 1 -- 172.21.15.77:0/739195729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc3406dae0 msgr2=0x7fbc340c1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc3af93640 1 --2- 172.21.15.77:0/739195729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc3406dae0 0x7fbc340c1e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009870 tx=0x7fbc2401c4d0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc3af93640 1 -- 172.21.15.77:0/739195729 shutdown_connections 2024-04-25T13:46:58.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc3af93640 1 --2- 172.21.15.77:0/739195729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc3406dae0 0x7fbc340c1e60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc3af93640 1 --2- 172.21.15.77:0/739195729 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc340c6840 0x7fbc34153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc3af93640 1 -- 172.21.15.77:0/739195729 >> 172.21.15.77:0/739195729 conn(0x7fbc340c79e0 msgr2=0x7fbc340c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:58.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc3af93640 1 -- 172.21.15.77:0/739195729 shutdown_connections 2024-04-25T13:46:58.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.874+0000 7fbc3af93640 1 -- 172.21.15.77:0/739195729 wait complete. 2024-04-25T13:46:58.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 Processor -- start 2024-04-25T13:46:58.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 -- start start 2024-04-25T13:46:58.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3406dae0 0x7fbc340bc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc340c23a0 0x7fbc340c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc340c6840 0x7fbc340c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc340ad730 con 0x7fbc340c6840 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbc340ad5b0 con 0x7fbc340c23a0 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fbc341526b0 con 0x7fbc3406dae0 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc39530640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc340c6840 0x7fbc340c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc39530640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc340c6840 0x7fbc340c0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51886/0 (socket says 172.21.15.77:51886) 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc39530640 1 -- 172.21.15.77:0/3049822455 learned_addr learned my addr 172.21.15.77:0/3049822455 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc38d2f640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3406dae0 0x7fbc340bc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc33fff640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc340c23a0 0x7fbc340c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc39530640 1 -- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3406dae0 msgr2=0x7fbc340bc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc39530640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3406dae0 0x7fbc340bc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc39530640 1 -- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc340c23a0 msgr2=0x7fbc340c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc39530640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc340c23a0 0x7fbc340c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc39530640 1 -- 172.21.15.77:0/3049822455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc340bcf30 con 0x7fbc340c6840 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc38d2f640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3406dae0 0x7fbc340bc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc33fff640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc340c23a0 0x7fbc340c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc39530640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc340c6840 0x7fbc340c0f90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c730 tx=0x7fbc2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc317fa640 1 -- 172.21.15.77:0/3049822455 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c003b80 con 0x7fbc340c6840 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc317fa640 1 -- 172.21.15.77:0/3049822455 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2c003d20 con 0x7fbc340c6840 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc317fa640 1 -- 172.21.15.77:0/3049822455 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c005310 con 0x7fbc340c6840 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3409cd20 con 0x7fbc340c6840 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc341efa10 con 0x7fbc340c6840 2024-04-25T13:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.878+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc3406a1a0 con 0x7fbc340c6840 2024-04-25T13:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.882+0000 7fbc317fa640 1 -- 172.21.15.77:0/3049822455 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbc2c0056c0 con 0x7fbc340c6840 2024-04-25T13:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.882+0000 7fbc317fa640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbc1c06f430 0x7fbc1c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.882+0000 7fbc317fa640 1 -- 172.21.15.77:0/3049822455 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fbc2c08f3d0 con 0x7fbc340c6840 2024-04-25T13:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.882+0000 7fbc38d2f640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbc1c06f430 0x7fbc1c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.882+0000 7fbc38d2f640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbc1c06f430 0x7fbc1c071940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbc3406f870 tx=0x7fbc20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:58.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:58.890+0000 7fbc317fa640 1 -- 172.21.15.77:0/3049822455 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbc2c05c230 con 0x7fbc340c6840 2024-04-25T13:46:59.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.050+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbc340bfbc0 con 0x7fbc340c6840 2024-04-25T13:46:59.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.050+0000 7fbc317fa640 1 -- 172.21.15.77:0/3049822455 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fbc2c0642b0 con 0x7fbc340c6840 2024-04-25T13:46:59.050 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T13:46:59.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbc1c06f430 msgr2=0x7fbc1c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbc1c06f430 0x7fbc1c071940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbc3406f870 tx=0x7fbc20008040 comp rx=0 tx=0).stop 2024-04-25T13:46:59.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc340c6840 msgr2=0x7fbc340c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc340c6840 0x7fbc340c0f90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c730 tx=0x7fbc2c00cbf0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 shutdown_connections 2024-04-25T13:46:59.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbc1c06f430 0x7fbc1c071940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc340c6840 0x7fbc340c0f90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc340c23a0 0x7fbc340c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 --2- 172.21.15.77:0/3049822455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3406dae0 0x7fbc340bc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 >> 172.21.15.77:0/3049822455 conn(0x7fbc340c79e0 msgr2=0x7fbc340c48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:59.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 shutdown_connections 2024-04-25T13:46:59.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.054+0000 7fbc3af93640 1 -- 172.21.15.77:0/3049822455 wait complete. 2024-04-25T13:46:59.074 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:46:59.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd26f1d640 1 Processor -- start 2024-04-25T13:46:59.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd26f1d640 1 -- start start 2024-04-25T13:46:59.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd26f1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbd2014fe10 0x7fbd20072e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd26f1d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 0x7fbd200737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd26f1d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd200741b0 con 0x7fbd2006fba0 2024-04-25T13:46:59.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd26f1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbd20071b10 con 0x7fbd2014fe10 2024-04-25T13:46:59.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd26f1d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fbd200bfe40 con 0x7fbd200733d0 2024-04-25T13:46:59.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd1ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbd2014fe10 0x7fbd20072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd24cb9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbd2006fba0 0x7fbd2014f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51726/0 (socket says 172.21.15.77:51726) 2024-04-25T13:46:59.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd24cb9640 1 -- 172.21.15.77:0/4255591151 learned_addr learned my addr 172.21.15.77:0/4255591151 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:59.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd1ffff640 1 -- 172.21.15.77:0/4255591151 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 msgr2=0x7fbd200737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:59.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd254ba640 1 --2- 172.21.15.77:0/4255591151 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 0x7fbd200737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd1ffff640 1 --2- 172.21.15.77:0/4255591151 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 0x7fbd200737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd1ffff640 1 -- 172.21.15.77:0/4255591151 >> v1:172.21.15.77:6789/0 conn(0x7fbd2006fba0 legacy=0x7fbd2014f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd1f7fe640 1 -- 172.21.15.77:0/4255591151 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563937045 0 0) 0x7fbd200741b0 con 0x7fbd2006fba0 2024-04-25T13:46:59.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd1ffff640 1 -- 172.21.15.77:0/4255591151 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd20073d20 con 0x7fbd2014fe10 2024-04-25T13:46:59.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.226+0000 7fbd254ba640 1 --2- 172.21.15.77:0/4255591151 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 0x7fbd200737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:59.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd1ffff640 1 --2- 172.21.15.77:0/4255591151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2014fe10 0x7fbd20072e90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd140097c0 tx=0x7fbd1401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5228f2beb435ba6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:59.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd1f7fe640 1 -- 172.21.15.77:0/4255591151 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd140b0070 con 0x7fbd2014fe10 2024-04-25T13:46:59.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd1f7fe640 1 -- 172.21.15.77:0/4255591151 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd140ab600 con 0x7fbd2014fe10 2024-04-25T13:46:59.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd1f7fe640 1 -- 172.21.15.77:0/4255591151 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd140ab9d0 con 0x7fbd2014fe10 2024-04-25T13:46:59.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 -- 172.21.15.77:0/4255591151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2014fe10 msgr2=0x7fbd20072e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 --2- 172.21.15.77:0/4255591151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2014fe10 0x7fbd20072e90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd140097c0 tx=0x7fbd1401c410 comp rx=0 tx=0).stop 2024-04-25T13:46:59.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 -- 172.21.15.77:0/4255591151 shutdown_connections 2024-04-25T13:46:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 --2- 172.21.15.77:0/4255591151 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 0x7fbd200737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 --2- 172.21.15.77:0/4255591151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2014fe10 0x7fbd20072e90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 -- 172.21.15.77:0/4255591151 >> 172.21.15.77:0/4255591151 conn(0x7fbd200c3cd0 msgr2=0x7fbd200c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 -- 172.21.15.77:0/4255591151 shutdown_connections 2024-04-25T13:46:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 -- 172.21.15.77:0/4255591151 wait complete. 2024-04-25T13:46:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 Processor -- start 2024-04-25T13:46:59.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.230+0000 7fbd26f1d640 1 -- start start 2024-04-25T13:46:59.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd26f1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2006fba0 0x7fbd200a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd26f1d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 0x7fbd20149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd26f1d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd2014fe10 0x7fbd20146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd26f1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200a8cc0 con 0x7fbd2006fba0 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd26f1d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2015d630 con 0x7fbd2014fe10 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd26f1d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2015d7b0 con 0x7fbd200733d0 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd24cb9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2006fba0 0x7fbd200a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd24cb9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2006fba0 0x7fbd200a8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51916/0 (socket says 172.21.15.77:51916) 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd24cb9640 1 -- 172.21.15.77:0/3681696290 learned_addr learned my addr 172.21.15.77:0/3681696290 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd1ffff640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 0x7fbd20149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd254ba640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd2014fe10 0x7fbd20146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd24cb9640 1 -- 172.21.15.77:0/3681696290 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 msgr2=0x7fbd20149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd24cb9640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 0x7fbd20149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd24cb9640 1 -- 172.21.15.77:0/3681696290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd2014fe10 msgr2=0x7fbd20146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd24cb9640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd2014fe10 0x7fbd20146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd24cb9640 1 -- 172.21.15.77:0/3681696290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd201475b0 con 0x7fbd2006fba0 2024-04-25T13:46:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd254ba640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd2014fe10 0x7fbd20146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd24cb9640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2006fba0 0x7fbd200a8510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c480 tx=0x7fbd1000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd1d7fa640 1 -- 172.21.15.77:0/3681696290 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10018070 con 0x7fbd2006fba0 2024-04-25T13:46:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd1d7fa640 1 -- 172.21.15.77:0/3681696290 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd10007500 con 0x7fbd2006fba0 2024-04-25T13:46:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd20149760 con 0x7fbd2006fba0 2024-04-25T13:46:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd1d7fa640 1 -- 172.21.15.77:0/3681696290 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10004a30 con 0x7fbd2006fba0 2024-04-25T13:46:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd20140f80 con 0x7fbd2006fba0 2024-04-25T13:46:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd20140950 con 0x7fbd2006fba0 2024-04-25T13:46:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd1d7fa640 1 -- 172.21.15.77:0/3681696290 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbd1001b070 con 0x7fbd2006fba0 2024-04-25T13:46:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd1d7fa640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbd0c06f400 0x7fbd0c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd1d7fa640 1 -- 172.21.15.77:0/3681696290 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fbd1008e5c0 con 0x7fbd2006fba0 2024-04-25T13:46:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd1ffff640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbd0c06f400 0x7fbd0c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.234+0000 7fbd1ffff640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbd0c06f400 0x7fbd0c071910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd140ad000 tx=0x7fbd14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:59.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.242+0000 7fbd1d7fa640 1 -- 172.21.15.77:0/3681696290 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd20140950 con 0x7fbd2006fba0 2024-04-25T13:46:59.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.402+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbd2006a1a0 con 0x7fbd2006fba0 2024-04-25T13:46:59.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.402+0000 7fbd1d7fa640 1 -- 172.21.15.77:0/3681696290 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fbd1005b540 con 0x7fbd2006fba0 2024-04-25T13:46:59.403 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T13:46:59.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbd0c06f400 msgr2=0x7fbd0c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbd0c06f400 0x7fbd0c071910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd140ad000 tx=0x7fbd14008040 comp rx=0 tx=0).stop 2024-04-25T13:46:59.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2006fba0 msgr2=0x7fbd200a8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2006fba0 0x7fbd200a8510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c480 tx=0x7fbd1000c940 comp rx=0 tx=0).stop 2024-04-25T13:46:59.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 shutdown_connections 2024-04-25T13:46:59.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fbd0c06f400 0x7fbd0c071910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd2014fe10 0x7fbd20146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd200733d0 0x7fbd20149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 --2- 172.21.15.77:0/3681696290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd2006fba0 0x7fbd200a8510 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 >> 172.21.15.77:0/3681696290 conn(0x7fbd200c3cd0 msgr2=0x7fbd200c01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:59.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 shutdown_connections 2024-04-25T13:46:59.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.406+0000 7fbd26f1d640 1 -- 172.21.15.77:0/3681696290 wait complete. 2024-04-25T13:46:59.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:46:59.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82fe213640 1 Processor -- start 2024-04-25T13:46:59.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82fe213640 1 -- start start 2024-04-25T13:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82fe213640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806fba0 0x7f82f814f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82fe213640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f80741b0 con 0x7f82f8153f80 2024-04-25T13:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82fe213640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f8071b10 con 0x7f82f814fc40 2024-04-25T13:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82fe213640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f82f80bfe40 con 0x7f82f806fba0 2024-04-25T13:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f82f8153f80 0x7f82f815ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51734/0 (socket says 172.21.15.77:51734) 2024-04-25T13:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f7fff640 1 -- 172.21.15.77:0/2447862595 learned_addr learned my addr 172.21.15.77:0/2447862595 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f77fe640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806fba0 0x7f82f814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034475978 0 0) 0x7f82f80741b0 con 0x7f82f8153f80 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82e0003530 con 0x7f82f8153f80 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3266922626 0 0) 0x7f82e0003530 con 0x7f82f8153f80 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806fba0 msgr2=0x7f82f814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806fba0 0x7f82f814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 >> v1:172.21.15.96:6789/0 conn(0x7f82f814fc40 legacy=0x7f82f8153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f8150050 con 0x7f82f8153f80 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f82f0001a00 con 0x7f82f8153f80 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 >> v1:172.21.15.77:6789/0 conn(0x7f82f8153f80 legacy=0x7f82f815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806fba0 0x7f82e0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e0003fe0 0x7f82e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82e00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82f80bfe40 con 0x7f82e0004d50 2024-04-25T13:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f82e000bc80 con 0x7f82e0003fe0 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f82e000be80 con 0x7f82f806fba0 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f7fff640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82e00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f6ffd640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e0003fe0 0x7f82e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.574+0000 7f82f77fe640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806fba0 0x7f82e0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f7fff640 1 -- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806fba0 msgr2=0x7f82e0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f7fff640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806fba0 0x7f82e0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f7fff640 1 -- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e0003fe0 msgr2=0x7f82e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f7fff640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e0003fe0 0x7f82e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f7fff640 1 -- 172.21.15.77:0/2447862595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e0003530 con 0x7f82e0004d50 2024-04-25T13:46:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f77fe640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806fba0 0x7f82e0003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:59.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f7fff640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82e00051e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f82f000a850 tx=0x7f82f001fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a17e1a0035dddbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:59.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f000a4a0 con 0x7f82e0004d50 2024-04-25T13:46:59.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f00ad070 con 0x7f82e0004d50 2024-04-25T13:46:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f67fc640 1 -- 172.21.15.77:0/2447862595 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f00a99c0 con 0x7f82e0004d50 2024-04-25T13:46:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82fe213640 1 -- 172.21.15.77:0/2447862595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 msgr2=0x7f82e00051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82fe213640 1 --2- 172.21.15.77:0/2447862595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82e00051e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f82f000a850 tx=0x7f82f001fb00 comp rx=0 tx=0).stop 2024-04-25T13:46:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82f7fff640 1 -- 172.21.15.77:0/2447862595 reap_dead start 2024-04-25T13:46:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82fe213640 1 -- 172.21.15.77:0/2447862595 shutdown_connections 2024-04-25T13:46:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82fe213640 1 -- 172.21.15.77:0/2447862595 >> 172.21.15.77:0/2447862595 conn(0x7f82f80c3cd0 msgr2=0x7f82f80c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82fe213640 1 -- 172.21.15.77:0/2447862595 shutdown_connections 2024-04-25T13:46:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.578+0000 7f82fe213640 1 -- 172.21.15.77:0/2447862595 wait complete. 2024-04-25T13:46:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 Processor -- start 2024-04-25T13:46:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 -- start start 2024-04-25T13:46:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82f80a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80a1c60 0x7f82f80a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f8149850 0x7f82f8149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82f80a8c30 con 0x7f82e0004d50 2024-04-25T13:46:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f82f80a8ab0 con 0x7f82f80a1c60 2024-04-25T13:46:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f82f8154390 con 0x7f82f8149850 2024-04-25T13:46:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82f80a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82f80a3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51934/0 (socket says 172.21.15.77:51934) 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f77fe640 1 -- 172.21.15.77:0/489823647 learned_addr learned my addr 172.21.15.77:0/489823647 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f7fff640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f8149850 0x7f82f8149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f6ffd640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80a1c60 0x7f82f80a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f77fe640 1 -- 172.21.15.77:0/489823647 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f8149850 msgr2=0x7f82f8149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f77fe640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f8149850 0x7f82f8149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f77fe640 1 -- 172.21.15.77:0/489823647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80a1c60 msgr2=0x7f82f80a40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f77fe640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80a1c60 0x7f82f80a40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f77fe640 1 -- 172.21.15.77:0/489823647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f81dbf50 con 0x7f82e0004d50 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f6ffd640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80a1c60 0x7f82f80a40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82f77fe640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82f80a3bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f82e80108d0 tx=0x7f82e8010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82dffff640 1 -- 172.21.15.77:0/489823647 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e800f040 con 0x7f82e0004d50 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82dffff640 1 -- 172.21.15.77:0/489823647 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e8004220 con 0x7f82e0004d50 2024-04-25T13:46:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82dffff640 1 -- 172.21.15.77:0/489823647 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e800e900 con 0x7f82e0004d50 2024-04-25T13:46:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f80a0b90 con 0x7f82e0004d50 2024-04-25T13:46:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f80a5480 con 0x7f82e0004d50 2024-04-25T13:46:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.582+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f806a1a0 con 0x7f82e0004d50 2024-04-25T13:46:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.586+0000 7f82dffff640 1 -- 172.21.15.77:0/489823647 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f82e800eaa0 con 0x7f82e0004d50 2024-04-25T13:46:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.586+0000 7f82dffff640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82e406f400 0x7f82e4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.586+0000 7f82f6ffd640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82e406f400 0x7f82e4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.586+0000 7f82dffff640 1 -- 172.21.15.77:0/489823647 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f82e808f330 con 0x7f82e0004d50 2024-04-25T13:46:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.586+0000 7f82f6ffd640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82e406f400 0x7f82e4071910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82f8150f60 tx=0x7f82ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:59.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.590+0000 7f82dffff640 1 -- 172.21.15.77:0/489823647 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82e8018030 con 0x7f82e0004d50 2024-04-25T13:46:59.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f82f81dc120 con 0x7f82e0004d50 2024-04-25T13:46:59.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82dffff640 1 -- 172.21.15.77:0/489823647 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f82e805c2b0 con 0x7f82e0004d50 2024-04-25T13:46:59.758 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-04-25T13:46:59.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82e406f400 msgr2=0x7f82e4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82e406f400 0x7f82e4071910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82f8150f60 tx=0x7f82ec009040 comp rx=0 tx=0).stop 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 msgr2=0x7f82f80a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82f80a3bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f82e80108d0 tx=0x7f82e8010d90 comp rx=0 tx=0).stop 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 shutdown_connections 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82e406f400 0x7f82e4071910 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f8149850 0x7f82f8149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80a1c60 0x7f82f80a40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 --2- 172.21.15.77:0/489823647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82e0004d50 0x7f82f80a3bb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.758+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 >> 172.21.15.77:0/489823647 conn(0x7f82f80c3cd0 msgr2=0x7f82f80c2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.762+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 shutdown_connections 2024-04-25T13:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.762+0000 7f82fe213640 1 -- 172.21.15.77:0/489823647 wait complete. 2024-04-25T13:46:59.780 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:46:59.780 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:46:59.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:46:59.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f181a22a640 1 Processor -- start 2024-04-25T13:46:59.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f181a22a640 1 -- start start 2024-04-25T13:46:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f181a22a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1814070ae0 0x7f1814070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f181a22a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1814150930 0x7f1814150d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f181a22a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1814153630 con 0x7f1814072a10 2024-04-25T13:46:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f181a22a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f18141504a0 con 0x7f1814070ae0 2024-04-25T13:46:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f181a22a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f18141538d0 con 0x7f1814150930 2024-04-25T13:46:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f1812ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1814070ae0 0x7f1814070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f18137fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1814072a10 0x7f181414f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51744/0 (socket says 172.21.15.77:51744) 2024-04-25T13:46:59.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f18137fe640 1 -- 172.21.15.77:0/1324863435 learned_addr learned my addr 172.21.15.77:0/1324863435 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:46:59.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f1813fff640 1 --2- 172.21.15.77:0/1324863435 >> v2:172.21.15.96:3300/0 conn(0x7f1814150930 0x7f1814150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f1812ffd640 1 -- 172.21.15.77:0/1324863435 >> v2:172.21.15.96:3300/0 conn(0x7f1814150930 msgr2=0x7f1814150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:46:59.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f1812ffd640 1 --2- 172.21.15.77:0/1324863435 >> v2:172.21.15.96:3300/0 conn(0x7f1814150930 0x7f1814150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f1812ffd640 1 -- 172.21.15.77:0/1324863435 >> v1:172.21.15.77:6789/0 conn(0x7f1814072a10 legacy=0x7f181414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.930+0000 7f1812ffd640 1 -- 172.21.15.77:0/1324863435 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1814150130 con 0x7f1814070ae0 2024-04-25T13:46:59.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f1812ffd640 1 --2- 172.21.15.77:0/1324863435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814070ae0 0x7f1814070ef0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1814150620 tx=0x7f17fc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73ae855fbf1391 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:59.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f18127fc640 1 -- 172.21.15.77:0/1324863435 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0b0070 con 0x7f1814070ae0 2024-04-25T13:46:59.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f18127fc640 1 -- 172.21.15.77:0/1324863435 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc0ab600 con 0x7f1814070ae0 2024-04-25T13:46:59.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f18127fc640 1 -- 172.21.15.77:0/1324863435 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0ab9d0 con 0x7f1814070ae0 2024-04-25T13:46:59.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f181a22a640 1 -- 172.21.15.77:0/1324863435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814070ae0 msgr2=0x7f1814070ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f181a22a640 1 --2- 172.21.15.77:0/1324863435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814070ae0 0x7f1814070ef0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1814150620 tx=0x7f17fc01c340 comp rx=0 tx=0).stop 2024-04-25T13:46:59.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f181a22a640 1 -- 172.21.15.77:0/1324863435 shutdown_connections 2024-04-25T13:46:59.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f181a22a640 1 --2- 172.21.15.77:0/1324863435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814070ae0 0x7f1814070ef0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f181a22a640 1 --2- 172.21.15.77:0/1324863435 >> v2:172.21.15.96:3300/0 conn(0x7f1814150930 0x7f1814150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f181a22a640 1 -- 172.21.15.77:0/1324863435 >> 172.21.15.77:0/1324863435 conn(0x7f18140c11e0 msgr2=0x7f18140c15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:46:59.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f181a22a640 1 -- 172.21.15.77:0/1324863435 shutdown_connections 2024-04-25T13:46:59.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.934+0000 7f181a22a640 1 -- 172.21.15.77:0/1324863435 wait complete. 2024-04-25T13:46:59.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 Processor -- start 2024-04-25T13:46:59.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 -- start start 2024-04-25T13:46:59.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1814070ae0 0x7f18141ec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1814072a10 0x7f1814149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814150930 0x7f1814143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1814073d30 con 0x7f1814150930 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1814073bb0 con 0x7f1814072a10 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f1814073eb0 con 0x7f1814070ae0 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1813fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814150930 0x7f1814143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1813fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814150930 0x7f1814143b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51940/0 (socket says 172.21.15.77:51940) 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1813fff640 1 -- 172.21.15.77:0/3961515221 learned_addr learned my addr 172.21.15.77:0/3961515221 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f18137fe640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1814070ae0 0x7f18141ec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1812ffd640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1814072a10 0x7f1814149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1813fff640 1 -- 172.21.15.77:0/3961515221 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1814070ae0 msgr2=0x7f18141ec4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1813fff640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1814070ae0 0x7f18141ec4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1813fff640 1 -- 172.21.15.77:0/3961515221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1814072a10 msgr2=0x7f1814149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1813fff640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1814072a10 0x7f1814149680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1813fff640 1 -- 172.21.15.77:0/3961515221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18141ed1e0 con 0x7f1814150930 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f1813fff640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814150930 0x7f1814143b40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f180c00cc30 tx=0x7f180c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f180bfff640 1 -- 172.21.15.77:0/3961515221 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c00ce40 con 0x7f1814150930 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f180bfff640 1 -- 172.21.15.77:0/3961515221 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f180c0039a0 con 0x7f1814150930 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181414ef00 con 0x7f1814150930 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f180bfff640 1 -- 172.21.15.77:0/3961515221 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c003d50 con 0x7f1814150930 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181414b7c0 con 0x7f1814150930 2024-04-25T13:46:59.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181406a280 con 0x7f1814150930 2024-04-25T13:46:59.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.938+0000 7f180bfff640 1 -- 172.21.15.77:0/3961515221 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f180c003f30 con 0x7f1814150930 2024-04-25T13:46:59.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.942+0000 7f180bfff640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f17f406f430 0x7f17f4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:46:59.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.942+0000 7f18137fe640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f17f406f430 0x7f17f4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:46:59.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.942+0000 7f180bfff640 1 -- 172.21.15.77:0/3961515221 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f180c08f730 con 0x7f1814150930 2024-04-25T13:46:59.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.942+0000 7f18137fe640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f17f406f430 0x7f17f4071940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18040010f0 tx=0x7f1804009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:46:59.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:46:59.946+0000 7f180bfff640 1 -- 172.21.15.77:0/3961515221 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f180c014030 con 0x7f1814150930 2024-04-25T13:47:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.098+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18140aa840 con 0x7f1814150930 2024-04-25T13:47:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.102+0000 7f180bfff640 1 -- 172.21.15.77:0/3961515221 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16853 (secure 0 0 0) 0x7f180c05c620 con 0x7f1814150930 2024-04-25T13:47:00.103 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:00.103 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:51.564949+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:47:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f17f406f430 msgr2=0x7f17f4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f17f406f430 0x7f17f4071940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18040010f0 tx=0x7f1804009040 comp rx=0 tx=0).stop 2024-04-25T13:47:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814150930 msgr2=0x7f1814143b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814150930 0x7f1814143b40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f180c00cc30 tx=0x7f180c00a5c0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 shutdown_connections 2024-04-25T13:47:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f17f406f430 0x7f17f4071940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1814150930 0x7f1814143b40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1814072a10 0x7f1814149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 --2- 172.21.15.77:0/3961515221 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1814070ae0 0x7f18141ec4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 >> 172.21.15.77:0/3961515221 conn(0x7f18140c11e0 msgr2=0x7f18140c0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 shutdown_connections 2024-04-25T13:47:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.106+0000 7f181a22a640 1 -- 172.21.15.77:0/3961515221 wait complete. 2024-04-25T13:47:00.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:40:58.420007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:41:01.460651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:41:02.746892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:47:00.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:47:00.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0ff73c640 1 Processor -- start 2024-04-25T13:47:00.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0ff73c640 1 -- start start 2024-04-25T13:47:00.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0ff73c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0f8074690 0x7fc0f8073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0ff73c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f80aadb0 con 0x7fc0f814d350 2024-04-25T13:47:00.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0ff73c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f80aaad0 con 0x7fc0f81502c0 2024-04-25T13:47:00.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0ff73c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f8154530 con 0x7fc0f8074690 2024-04-25T13:47:00.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fccd7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc0f814d350 0x7fc0f814d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55242/0 (socket says 172.21.15.77:55242) 2024-04-25T13:47:00.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fccd7640 1 -- 172.21.15.77:0/3226656662 learned_addr learned my addr 172.21.15.77:0/3226656662 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:00.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fd4d8640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0f8074690 0x7fc0f8073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830539695 0 0) 0x7fc0f80aadb0 con 0x7fc0f814d350 2024-04-25T13:47:00.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0e4003530 con 0x7fc0f814d350 2024-04-25T13:47:00.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1853177561 0 0) 0x7fc0e4003530 con 0x7fc0f814d350 2024-04-25T13:47:00.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0f8074690 msgr2=0x7fc0f8073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:00.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0f8074690 0x7fc0f8073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 >> v1:172.21.15.96:6789/0 conn(0x7fc0f81502c0 legacy=0x7fc0f81506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f80740e0 con 0x7fc0f814d350 2024-04-25T13:47:00.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fc0e8001680 con 0x7fc0f814d350 2024-04-25T13:47:00.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 >> v1:172.21.15.77:6789/0 conn(0x7fc0f814d350 legacy=0x7fc0f814d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0f8074690 0x7fc0e4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0e4003fe0 0x7fc0e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0e4004d50 0x7fc0e40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e400bc50 con 0x7fc0e4003fe0 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fccd7640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0e4003fe0 0x7fc0e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e400be00 con 0x7fc0e4004d50 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e400c000 con 0x7fc0f8074690 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fd4d8640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0f8074690 0x7fc0e4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fccd7640 1 -- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0f8074690 msgr2=0x7fc0e4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fccd7640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0f8074690 0x7fc0e4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fccd7640 1 -- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0e4004d50 msgr2=0x7fc0e40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fccd7640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0e4004d50 0x7fc0e40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.278+0000 7fc0fccd7640 1 -- 172.21.15.77:0/3226656662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e4003530 con 0x7fc0e4003fe0 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0fccd7640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0e4003fe0 0x7fc0e4004810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8072900 tx=0x7fc0e801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed001ea591bb5194 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8007da0 con 0x7fc0e4003fe0 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e80a9070 con 0x7fc0e4003fe0 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0effff640 1 -- 172.21.15.77:0/3226656662 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8005ce0 con 0x7fc0e4003fe0 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0ff73c640 1 -- 172.21.15.77:0/3226656662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0e4003fe0 msgr2=0x7fc0e4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0ff73c640 1 --2- 172.21.15.77:0/3226656662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0e4003fe0 0x7fc0e4004810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8072900 tx=0x7fc0e801cc00 comp rx=0 tx=0).stop 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0fdcd9640 1 -- 172.21.15.77:0/3226656662 reap_dead start 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0ff73c640 1 -- 172.21.15.77:0/3226656662 shutdown_connections 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0ff73c640 1 -- 172.21.15.77:0/3226656662 >> 172.21.15.77:0/3226656662 conn(0x7fc0f80a7d80 msgr2=0x7fc0f80c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0ff73c640 1 -- 172.21.15.77:0/3226656662 shutdown_connections 2024-04-25T13:47:00.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.282+0000 7fc0ff73c640 1 -- 172.21.15.77:0/3226656662 wait complete. 2024-04-25T13:47:00.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 Processor -- start 2024-04-25T13:47:00.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 -- start start 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0e4003fe0 0x7fc0f814f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f8141270 0x7fc0f8141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f81ed2f0 0x7fc0f81ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f815c670 con 0x7fc0f8141270 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f80aa880 con 0x7fc0f81ed2f0 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f815c7f0 con 0x7fc0e4003fe0 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fccd7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f8141270 0x7fc0f8141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fccd7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f8141270 0x7fc0f8141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54874/0 (socket says 172.21.15.77:54874) 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fccd7640 1 -- 172.21.15.77:0/2415459367 learned_addr learned my addr 172.21.15.77:0/2415459367 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fd4d8640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0e4003fe0 0x7fc0f814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fdcd9640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f81ed2f0 0x7fc0f81ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fccd7640 1 -- 172.21.15.77:0/2415459367 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0e4003fe0 msgr2=0x7fc0f814f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fccd7640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0e4003fe0 0x7fc0f814f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fccd7640 1 -- 172.21.15.77:0/2415459367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f81ed2f0 msgr2=0x7fc0f81ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fccd7640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f81ed2f0 0x7fc0f81ed700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fccd7640 1 -- 172.21.15.77:0/2415459367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f8153640 con 0x7fc0f8141270 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0fccd7640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f8141270 0x7fc0f8141680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc0e801ca30 tx=0x7fc0e4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0edffb640 1 -- 172.21.15.77:0/2415459367 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8007d80 con 0x7fc0f8141270 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0edffb640 1 -- 172.21.15.77:0/2415459367 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e80a6dc0 con 0x7fc0f8141270 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f8151950 con 0x7fc0f8141270 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0edffb640 1 -- 172.21.15.77:0/2415459367 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8004a10 con 0x7fc0f8141270 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f81ee060 con 0x7fc0f8141270 2024-04-25T13:47:00.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.286+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f8153810 con 0x7fc0f8141270 2024-04-25T13:47:00.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.290+0000 7fc0edffb640 1 -- 172.21.15.77:0/2415459367 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc0e8004bb0 con 0x7fc0f8141270 2024-04-25T13:47:00.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.290+0000 7fc0edffb640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc0dc06f430 0x7fc0dc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.290+0000 7fc0fd4d8640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc0dc06f430 0x7fc0dc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.290+0000 7fc0edffb640 1 -- 172.21.15.77:0/2415459367 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fc0e8129400 con 0x7fc0f8141270 2024-04-25T13:47:00.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.290+0000 7fc0fd4d8640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc0dc06f430 0x7fc0dc071940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ab3c0 tx=0x7fc0f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:00.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.294+0000 7fc0edffb640 1 -- 172.21.15.77:0/2415459367 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0f8153810 con 0x7fc0f8141270 2024-04-25T13:47:00.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc0f806a1a0 con 0x7fc0f8141270 2024-04-25T13:47:00.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0edffb640 1 -- 172.21.15.77:0/2415459367 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fc0e8016910 con 0x7fc0f8141270 2024-04-25T13:47:00.458 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T13:47:00.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc0dc06f430 msgr2=0x7fc0dc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc0dc06f430 0x7fc0dc071940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ab3c0 tx=0x7fc0f4008040 comp rx=0 tx=0).stop 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f8141270 msgr2=0x7fc0f8141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f8141270 0x7fc0f8141680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc0e801ca30 tx=0x7fc0e4005840 comp rx=0 tx=0).stop 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 shutdown_connections 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc0dc06f430 0x7fc0dc071940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc0f81ed2f0 0x7fc0f81ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f8141270 0x7fc0f8141680 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 --2- 172.21.15.77:0/2415459367 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc0e4003fe0 0x7fc0f814f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 >> 172.21.15.77:0/2415459367 conn(0x7fc0f80a7d80 msgr2=0x7fc0f80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 shutdown_connections 2024-04-25T13:47:00.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.458+0000 7fc0ff73c640 1 -- 172.21.15.77:0/2415459367 wait complete. 2024-04-25T13:47:00.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:47:00.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230fed9640 1 Processor -- start 2024-04-25T13:47:00.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230fed9640 1 -- start start 2024-04-25T13:47:00.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230fed9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f230806fba0 0x7f230814f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230fed9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2308153f80 0x7f230815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230fed9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23080741b0 con 0x7f230814fc40 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230fed9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2308071b10 con 0x7f230806fba0 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230fed9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f23080bfe40 con 0x7f2308153f80 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230dc75640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f230806fba0 0x7f230814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230dc75640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f230806fba0 0x7f230814f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54886/0 (socket says 172.21.15.77:54886) 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230dc75640 1 -- 172.21.15.77:0/1209854054 learned_addr learned my addr 172.21.15.77:0/1209854054 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230e476640 1 --2- 172.21.15.77:0/1209854054 >> v2:172.21.15.96:3300/0 conn(0x7f2308153f80 0x7f230815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230dc75640 1 -- 172.21.15.77:0/1209854054 >> v2:172.21.15.96:3300/0 conn(0x7f2308153f80 msgr2=0x7f230815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230dc75640 1 --2- 172.21.15.77:0/1209854054 >> v2:172.21.15.96:3300/0 conn(0x7f2308153f80 0x7f230815ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230dc75640 1 -- 172.21.15.77:0/1209854054 >> v1:172.21.15.96:6789/0 conn(0x7f230814fc40 legacy=0x7f2308153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:00.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.626+0000 7f230dc75640 1 -- 172.21.15.77:0/1209854054 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2308150050 con 0x7f230806fba0 2024-04-25T13:47:00.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230dc75640 1 --2- 172.21.15.77:0/1209854054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f230806fba0 0x7f230814f700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f23080a6290 tx=0x7f22f801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61dd796e9f6653d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:00.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230cc73640 1 -- 172.21.15.77:0/1209854054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f80b0070 con 0x7f230806fba0 2024-04-25T13:47:00.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230cc73640 1 -- 172.21.15.77:0/1209854054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f80ab600 con 0x7f230806fba0 2024-04-25T13:47:00.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230cc73640 1 -- 172.21.15.77:0/1209854054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f80ab9d0 con 0x7f230806fba0 2024-04-25T13:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230fed9640 1 -- 172.21.15.77:0/1209854054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f230806fba0 msgr2=0x7f230814f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230fed9640 1 --2- 172.21.15.77:0/1209854054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f230806fba0 0x7f230814f700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f23080a6290 tx=0x7f22f801c450 comp rx=0 tx=0).stop 2024-04-25T13:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230fed9640 1 -- 172.21.15.77:0/1209854054 shutdown_connections 2024-04-25T13:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230fed9640 1 --2- 172.21.15.77:0/1209854054 >> v2:172.21.15.96:3300/0 conn(0x7f2308153f80 0x7f230815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230fed9640 1 --2- 172.21.15.77:0/1209854054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f230806fba0 0x7f230814f700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230fed9640 1 -- 172.21.15.77:0/1209854054 >> 172.21.15.77:0/1209854054 conn(0x7f23080c3cd0 msgr2=0x7f23080c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230fed9640 1 -- 172.21.15.77:0/1209854054 shutdown_connections 2024-04-25T13:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.630+0000 7f230fed9640 1 -- 172.21.15.77:0/1209854054 wait complete. 2024-04-25T13:47:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 Processor -- start 2024-04-25T13:47:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 -- start start 2024-04-25T13:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f230806fba0 0x7f2308155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230814fc40 0x7f2308148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308153f80 0x7f23081ed310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f23080a8cc0 con 0x7f2308153f80 2024-04-25T13:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f230815db70 con 0x7f230806fba0 2024-04-25T13:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f230815dcf0 con 0x7f230814fc40 2024-04-25T13:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230e476640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308153f80 0x7f23081ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230e476640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308153f80 0x7f23081ed310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54900/0 (socket says 172.21.15.77:54900) 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230e476640 1 -- 172.21.15.77:0/1489969309 learned_addr learned my addr 172.21.15.77:0/1489969309 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230d474640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230814fc40 0x7f2308148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230dc75640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f230806fba0 0x7f2308155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230e476640 1 -- 172.21.15.77:0/1489969309 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230814fc40 msgr2=0x7f2308148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230e476640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230814fc40 0x7f2308148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230e476640 1 -- 172.21.15.77:0/1489969309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f230806fba0 msgr2=0x7f2308155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230e476640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f230806fba0 0x7f2308155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230e476640 1 -- 172.21.15.77:0/1489969309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2308148960 con 0x7f2308153f80 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230e476640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308153f80 0x7f23081ed310 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2300007d80 tx=0x7f230000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f22fe7fc640 1 -- 172.21.15.77:0/1489969309 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300014420 con 0x7f2308153f80 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f22fe7fc640 1 -- 172.21.15.77:0/1489969309 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2300019070 con 0x7f2308153f80 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23081edb30 con 0x7f2308153f80 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f22fe7fc640 1 -- 172.21.15.77:0/1489969309 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300014800 con 0x7f2308153f80 2024-04-25T13:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.634+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2308148f70 con 0x7f2308153f80 2024-04-25T13:47:00.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.638+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f230806a1a0 con 0x7f2308153f80 2024-04-25T13:47:00.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.638+0000 7f22fe7fc640 1 -- 172.21.15.77:0/1489969309 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f23000149a0 con 0x7f2308153f80 2024-04-25T13:47:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.638+0000 7f22fe7fc640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f22ec06f430 0x7f22ec071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.638+0000 7f22fe7fc640 1 -- 172.21.15.77:0/1489969309 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f2300090590 con 0x7f2308153f80 2024-04-25T13:47:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.638+0000 7f230dc75640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f22ec06f430 0x7f22ec071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.638+0000 7f230dc75640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f22ec06f430 0x7f22ec071940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22f80ad000 tx=0x7f22f80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:00.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.642+0000 7f22fe7fc640 1 -- 172.21.15.77:0/1489969309 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f230005d4d0 con 0x7f2308153f80 2024-04-25T13:47:00.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.794+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f23080a7390 con 0x7f2308153f80 2024-04-25T13:47:00.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.794+0000 7f22fe7fc640 1 -- 172.21.15.77:0/1489969309 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f230005cdd0 con 0x7f2308153f80 2024-04-25T13:47:00.795 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T13:47:00.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f22ec06f430 msgr2=0x7f22ec071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f22ec06f430 0x7f22ec071940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22f80ad000 tx=0x7f22f80a6000 comp rx=0 tx=0).stop 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308153f80 msgr2=0x7f23081ed310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308153f80 0x7f23081ed310 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2300007d80 tx=0x7f230000e4b0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 shutdown_connections 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f22ec06f430 0x7f22ec071940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308153f80 0x7f23081ed310 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f230814fc40 0x7f2308148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 --2- 172.21.15.77:0/1489969309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f230806fba0 0x7f2308155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 >> 172.21.15.77:0/1489969309 conn(0x7f23080c3cd0 msgr2=0x7f23080c01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 shutdown_connections 2024-04-25T13:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.798+0000 7f230fed9640 1 -- 172.21.15.77:0/1489969309 wait complete. 2024-04-25T13:47:00.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:47:00.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c3297a640 1 Processor -- start 2024-04-25T13:47:00.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c3297a640 1 -- start start 2024-04-25T13:47:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c3297a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c2c14fe10 0x7f7c2c072e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c3297a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c0733d0 0x7f7c2c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c3297a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c2c0741b0 con 0x7f7c2c06fba0 2024-04-25T13:47:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c3297a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2c071b10 con 0x7f7c2c14fe10 2024-04-25T13:47:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c3297a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2c0bfe40 con 0x7f7c2c0733d0 2024-04-25T13:47:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7c2c06fba0 0x7f7c2c14f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55246/0 (socket says 172.21.15.77:55246) 2024-04-25T13:47:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2bfff640 1 -- 172.21.15.77:0/640335884 learned_addr learned my addr 172.21.15.77:0/640335884 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c30f17640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c0733d0 0x7f7c2c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2b7fe640 1 --2- 172.21.15.77:0/640335884 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c14fe10 0x7f7c2c072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366263173 0 0) 0x7f7c2c0741b0 con 0x7f7c2c06fba0 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c14003530 con 0x7f7c2c06fba0 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1290331756 0 0) 0x7f7c14003530 con 0x7f7c2c06fba0 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c0733d0 msgr2=0x7f7c2c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c0733d0 0x7f7c2c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c14fe10 msgr2=0x7f7c2c072e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 --2- 172.21.15.77:0/640335884 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c14fe10 0x7f7c2c072e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c073d20 con 0x7f7c2c06fba0 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f7c1c001680 con 0x7f7c2c06fba0 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 >> v1:172.21.15.77:6789/0 conn(0x7f7c2c06fba0 legacy=0x7f7c2c14f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c14003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c14004810 0x7f7c14004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c0733d0 0x7f7c14005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c071b10 con 0x7f7c14003a30 2024-04-25T13:47:00.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c0bfe40 con 0x7f7c14004810 2024-04-25T13:47:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f7c1400bad0 con 0x7f7c2c0733d0 2024-04-25T13:47:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2bfff640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c14003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2b7fe640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c14004810 0x7f7c14004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c30f17640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c0733d0 0x7f7c14005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2bfff640 1 -- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c0733d0 msgr2=0x7f7c14005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2bfff640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c0733d0 0x7f7c14005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2bfff640 1 -- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c14004810 msgr2=0x7f7c14004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2bfff640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c14004810 0x7f7c14004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.954+0000 7f7c2bfff640 1 -- 172.21.15.77:0/640335884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c14003530 con 0x7f7c14003a30 2024-04-25T13:47:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c2bfff640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c14003ea0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c240 tx=0x7f7c1c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acda2bb51b70ffd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c007d60 con 0x7f7c14003a30 2024-04-25T13:47:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0a9020 con 0x7f7c14003a30 2024-04-25T13:47:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c2affd640 1 -- 172.21.15.77:0/640335884 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c005ae0 con 0x7f7c14003a30 2024-04-25T13:47:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c3297a640 1 -- 172.21.15.77:0/640335884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 msgr2=0x7f7c14003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c3297a640 1 --2- 172.21.15.77:0/640335884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c14003ea0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c240 tx=0x7f7c1c01ccc0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c30f17640 1 -- 172.21.15.77:0/640335884 reap_dead start 2024-04-25T13:47:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c3297a640 1 -- 172.21.15.77:0/640335884 shutdown_connections 2024-04-25T13:47:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c3297a640 1 -- 172.21.15.77:0/640335884 >> 172.21.15.77:0/640335884 conn(0x7f7c2c0c3cd0 msgr2=0x7f7c2c0c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c3297a640 1 -- 172.21.15.77:0/640335884 shutdown_connections 2024-04-25T13:47:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c3297a640 1 -- 172.21.15.77:0/640335884 wait complete. 2024-04-25T13:47:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c3297a640 1 Processor -- start 2024-04-25T13:47:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.958+0000 7f7c3297a640 1 -- start start 2024-04-25T13:47:00.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c3297a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c2c0a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c3297a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c158030 0x7f7c2c148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c3297a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c148ea0 0x7f7c2c1eb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c3297a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c0a8cc0 con 0x7f7c14003a30 2024-04-25T13:47:00.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c3297a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c0701c0 con 0x7f7c2c158030 2024-04-25T13:47:00.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c3297a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2c15b620 con 0x7f7c2c148ea0 2024-04-25T13:47:00.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c2c0a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c2c0a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54912/0 (socket says 172.21.15.77:54912) 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2bfff640 1 -- 172.21.15.77:0/2453314359 learned_addr learned my addr 172.21.15.77:0/2453314359 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c30f17640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c148ea0 0x7f7c2c1eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2b7fe640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c158030 0x7f7c2c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2bfff640 1 -- 172.21.15.77:0/2453314359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c148ea0 msgr2=0x7f7c2c1eb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2bfff640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c148ea0 0x7f7c2c1eb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2bfff640 1 -- 172.21.15.77:0/2453314359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c158030 msgr2=0x7f7c2c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2bfff640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c158030 0x7f7c2c148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2bfff640 1 -- 172.21.15.77:0/2453314359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c0a1e90 con 0x7f7c14003a30 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c30f17640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c148ea0 0x7f7c2c1eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c2bfff640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c2c0a07e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ab040 tx=0x7f7c14005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c28ff9640 1 -- 172.21.15.77:0/2453314359 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c001ca0 con 0x7f7c14003a30 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c28ff9640 1 -- 172.21.15.77:0/2453314359 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0049f0 con 0x7f7c14003a30 2024-04-25T13:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2c157d20 con 0x7f7c14003a30 2024-04-25T13:47:00.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c28ff9640 1 -- 172.21.15.77:0/2453314359 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c004de0 con 0x7f7c14003a30 2024-04-25T13:47:00.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2c1492b0 con 0x7f7c14003a30 2024-04-25T13:47:00.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2c152180 con 0x7f7c14003a30 2024-04-25T13:47:00.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c28ff9640 1 -- 172.21.15.77:0/2453314359 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7c1c0a57a0 con 0x7f7c14003a30 2024-04-25T13:47:00.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.962+0000 7f7c28ff9640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c1806f430 0x7f7c18071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:00.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.966+0000 7f7c2b7fe640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c1806f430 0x7f7c18071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:00.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.966+0000 7f7c28ff9640 1 -- 172.21.15.77:0/2453314359 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f7c1c128dc0 con 0x7f7c14003a30 2024-04-25T13:47:00.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.966+0000 7f7c2b7fe640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c1806f430 0x7f7c18071940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c14f270 tx=0x7f7c20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:00.966+0000 7f7c28ff9640 1 -- 172.21.15.77:0/2453314359 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c1c0169d0 con 0x7f7c14003a30 2024-04-25T13:47:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.130+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7c2c06a1a0 con 0x7f7c14003a30 2024-04-25T13:47:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.130+0000 7f7c28ff9640 1 -- 172.21.15.77:0/2453314359 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f7c1c0f5d40 con 0x7f7c14003a30 2024-04-25T13:47:01.130 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T13:47:01.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c1806f430 msgr2=0x7f7c18071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c1806f430 0x7f7c18071940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c14f270 tx=0x7f7c20008040 comp rx=0 tx=0).stop 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 msgr2=0x7f7c2c0a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c2c0a07e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ab040 tx=0x7f7c14005840 comp rx=0 tx=0).stop 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 shutdown_connections 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7c1806f430 0x7f7c18071940 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c148ea0 0x7f7c2c1eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c158030 0x7f7c2c148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 --2- 172.21.15.77:0/2453314359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c14003a30 0x7f7c2c0a07e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 >> 172.21.15.77:0/2453314359 conn(0x7f7c2c0c3cd0 msgr2=0x7f7c2c0a2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 shutdown_connections 2024-04-25T13:47:01.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.134+0000 7f7c3297a640 1 -- 172.21.15.77:0/2453314359 wait complete. 2024-04-25T13:47:01.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:47:01.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.302+0000 7f241b0b2640 1 Processor -- start 2024-04-25T13:47:01.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.302+0000 7f241b0b2640 1 -- start start 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241b0b2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f241414e710 0x7f241414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241b0b2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24141535c0 con 0x7f241414f060 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241b0b2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24140a5990 con 0x7f24140a5580 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241b0b2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f24140a3760 con 0x7f241414e710 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241964f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f241414f060 0x7f241414f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55260/0 (socket says 172.21.15.77:55260) 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241964f640 1 -- 172.21.15.77:0/873987762 learned_addr learned my addr 172.21.15.77:0/873987762 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f2413fff640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f241414e710 0x7f241414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385725947 0 0) 0x7f24141535c0 con 0x7f241414f060 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2404003530 con 0x7f241414f060 2024-04-25T13:47:01.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2503864181 0 0) 0x7f2404003530 con 0x7f241414f060 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f241414e710 msgr2=0x7f241414eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f241414e710 0x7f241414eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 >> v1:172.21.15.96:6789/0 conn(0x7f24140a5580 legacy=0x7f241406f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24141532e0 con 0x7f241414f060 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f240c001a00 con 0x7f241414f060 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 >> v1:172.21.15.77:6789/0 conn(0x7f241414f060 legacy=0x7f241414f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f241414e710 0x7f2404003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2404003fe0 0x7f2404004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2404004d50 0x7f24040051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24140a3760 con 0x7f2404004d50 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f240400bbe0 con 0x7f2404003fe0 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f240400bde0 con 0x7f241414e710 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241964f640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2404004d50 0x7f24040051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:01.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f2418e4e640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f241414e710 0x7f2404003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:01.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f2413fff640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2404003fe0 0x7f2404004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:01.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241964f640 1 -- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f241414e710 msgr2=0x7f2404003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:01.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241964f640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f241414e710 0x7f2404003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241964f640 1 -- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2404003fe0 msgr2=0x7f2404004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:01.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241964f640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2404003fe0 0x7f2404004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241964f640 1 -- 172.21.15.77:0/873987762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2404003530 con 0x7f2404004d50 2024-04-25T13:47:01.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f2413fff640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2404003fe0 0x7f2404004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:01.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.306+0000 7f241964f640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2404004d50 0x7f24040051e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2414071cb0 tx=0x7f240c01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c4c01a2d2d819b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:01.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c00a480 con 0x7f2404004d50 2024-04-25T13:47:01.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c0ad650 con 0x7f2404004d50 2024-04-25T13:47:01.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f24137fe640 1 -- 172.21.15.77:0/873987762 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c0ada40 con 0x7f2404004d50 2024-04-25T13:47:01.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 -- 172.21.15.77:0/873987762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2404004d50 msgr2=0x7f24040051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:01.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 --2- 172.21.15.77:0/873987762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2404004d50 0x7f24040051e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2414071cb0 tx=0x7f240c01d300 comp rx=0 tx=0).stop 2024-04-25T13:47:01.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241964f640 1 -- 172.21.15.77:0/873987762 reap_dead start 2024-04-25T13:47:01.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 -- 172.21.15.77:0/873987762 shutdown_connections 2024-04-25T13:47:01.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 -- 172.21.15.77:0/873987762 >> 172.21.15.77:0/873987762 conn(0x7f24140c3cd0 msgr2=0x7f24140c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:01.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 -- 172.21.15.77:0/873987762 shutdown_connections 2024-04-25T13:47:01.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 -- 172.21.15.77:0/873987762 wait complete. 2024-04-25T13:47:01.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 Processor -- start 2024-04-25T13:47:01.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 -- start start 2024-04-25T13:47:01.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f24141daae0 0x7f241414b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2414142420 0x7f2414142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24141e84b0 0x7f24141e88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f241414eb20 con 0x7f2414142420 2024-04-25T13:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f24140700e0 con 0x7f24141e84b0 2024-04-25T13:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f241b0b2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f241414eca0 con 0x7f24141daae0 2024-04-25T13:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f2413fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2414142420 0x7f2414142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.310+0000 7f2413fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2414142420 0x7f2414142830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54934/0 (socket says 172.21.15.77:54934) 2024-04-25T13:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2413fff640 1 -- 172.21.15.77:0/2076389237 learned_addr learned my addr 172.21.15.77:0/2076389237 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2418e4e640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f24141daae0 0x7f241414b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f241964f640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24141e84b0 0x7f24141e88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2413fff640 1 -- 172.21.15.77:0/2076389237 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f24141daae0 msgr2=0x7f241414b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2413fff640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f24141daae0 0x7f241414b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2413fff640 1 -- 172.21.15.77:0/2076389237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24141e84b0 msgr2=0x7f24141e88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2413fff640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24141e84b0 0x7f24141e88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2413fff640 1 -- 172.21.15.77:0/2076389237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2414142d70 con 0x7f2414142420 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2418e4e640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f24141daae0 0x7f241414b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2413fff640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2414142420 0x7f2414142830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2400010900 tx=0x7f2400010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f24117fa640 1 -- 172.21.15.77:0/2076389237 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240000f040 con 0x7f2414142420 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f24117fa640 1 -- 172.21.15.77:0/2076389237 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240000ec20 con 0x7f2414142420 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24141d8e30 con 0x7f2414142420 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f24117fa640 1 -- 172.21.15.77:0/2076389237 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400004020 con 0x7f2414142420 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2414073ba0 con 0x7f2414142420 2024-04-25T13:47:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f241406a1a0 con 0x7f2414142420 2024-04-25T13:47:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f24117fa640 1 -- 172.21.15.77:0/2076389237 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f24000041c0 con 0x7f2414142420 2024-04-25T13:47:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f24117fa640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f23f806f400 0x7f23f8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f24117fa640 1 -- 172.21.15.77:0/2076389237 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f240008f750 con 0x7f2414142420 2024-04-25T13:47:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2418e4e640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f23f806f400 0x7f23f8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.314+0000 7f2418e4e640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f23f806f400 0x7f23f8071910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24141d9140 tx=0x7f2408009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.318+0000 7f24117fa640 1 -- 172.21.15.77:0/2076389237 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2414142d70 con 0x7f2414142420 2024-04-25T13:47:01.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.494+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f241406d5c0 con 0x7f2414142420 2024-04-25T13:47:01.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.494+0000 7f24117fa640 1 -- 172.21.15.77:0/2076389237 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f2400018030 con 0x7f2414142420 2024-04-25T13:47:01.496 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-04-25T13:47:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f23f806f400 msgr2=0x7f23f8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f23f806f400 0x7f23f8071910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24141d9140 tx=0x7f2408009040 comp rx=0 tx=0).stop 2024-04-25T13:47:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2414142420 msgr2=0x7f2414142830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2414142420 0x7f2414142830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2400010900 tx=0x7f2400010dc0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 shutdown_connections 2024-04-25T13:47:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f23f806f400 0x7f23f8071910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24141e84b0 0x7f24141e88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2414142420 0x7f2414142830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 --2- 172.21.15.77:0/2076389237 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f24141daae0 0x7f241414b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 >> 172.21.15.77:0/2076389237 conn(0x7f24140c3cd0 msgr2=0x7f2414150980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 shutdown_connections 2024-04-25T13:47:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:01.498+0000 7f241b0b2640 1 -- 172.21.15.77:0/2076389237 wait complete. 2024-04-25T13:47:01.517 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi191.front.sepia.ceph.com... 2024-04-25T13:47:01.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:01.517 DEBUG:teuthology.orchestra.run.smithi191:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-25T13:47:01.592 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi191.stderr:ceph-fuse[22810]: fuse finished with error 0 and tester_r 0 2024-04-25T13:47:01.593 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:07.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:47:07.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:07.695 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T13:47:07.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:07.702 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-04-25T13:47:07.751 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 0) 2024-04-25T13:47:07.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:07.752 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:47:07.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:07.807 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2024-04-25T13:47:07.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:07.955 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2024-04-25T13:47:07.962 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T13:47:07.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:07.962 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:47:08.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:08.020 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2024-04-25T13:47:08.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:08.216 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-04-25T13:47:08.223 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T13:47:08.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:08.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:47:08.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:47:08.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2024-04-25T13:47:08.442 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T13:47:08.453 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:47:08.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:47:08.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.610+0000 7ff064236640 1 Processor -- start 2024-04-25T13:47:08.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.610+0000 7ff064236640 1 -- start start 2024-04-25T13:47:08.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff064236640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff05c0a93a0 0x7ff05c0a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:08.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff064236640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff05c151fe0 0x7ff05c1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:08.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff064236640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 0x7ff05c14dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:08.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff064236640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff05c0a97b0 con 0x7ff05c0a93a0 2024-04-25T13:47:08.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff064236640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff05c073ed0 con 0x7ff05c151fe0 2024-04-25T13:47:08.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff064236640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff05c074380 con 0x7ff05c152930 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff061fd2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff05c0a93a0 0x7ff05c0a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff061fd2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff05c0a93a0 0x7ff05c0a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54946/0 (socket says 172.21.15.77:54946) 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff061fd2640 1 -- 172.21.15.77:0/3098388850 learned_addr learned my addr 172.21.15.77:0/3098388850 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff0617d1640 1 --2- 172.21.15.77:0/3098388850 >> v2:172.21.15.96:3300/0 conn(0x7ff05c151fe0 0x7ff05c1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff0627d3640 1 --2- 172.21.15.77:0/3098388850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 0x7ff05c14dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff061fd2640 1 -- 172.21.15.77:0/3098388850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 msgr2=0x7ff05c14dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff061fd2640 1 --2- 172.21.15.77:0/3098388850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 0x7ff05c14dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff061fd2640 1 -- 172.21.15.77:0/3098388850 >> v2:172.21.15.96:3300/0 conn(0x7ff05c151fe0 msgr2=0x7ff05c1523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff061fd2640 1 --2- 172.21.15.77:0/3098388850 >> v2:172.21.15.96:3300/0 conn(0x7ff05c151fe0 0x7ff05c1523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.614+0000 7ff061fd2640 1 -- 172.21.15.77:0/3098388850 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c0a8020 con 0x7ff05c0a93a0 2024-04-25T13:47:08.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff061fd2640 1 --2- 172.21.15.77:0/3098388850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 0x7ff05c0a7190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff05c073b70 tx=0x7ff05401d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3225b0afcb9876 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:08.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff060fd0640 1 -- 172.21.15.77:0/3098388850 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05400b040 con 0x7ff05c0a93a0 2024-04-25T13:47:08.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff060fd0640 1 -- 172.21.15.77:0/3098388850 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0540a76e0 con 0x7ff05c0a93a0 2024-04-25T13:47:08.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff060fd0640 1 -- 172.21.15.77:0/3098388850 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0540a7ab0 con 0x7ff05c0a93a0 2024-04-25T13:47:08.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 -- 172.21.15.77:0/3098388850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 msgr2=0x7ff05c0a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:08.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 --2- 172.21.15.77:0/3098388850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 0x7ff05c0a7190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff05c073b70 tx=0x7ff05401d7b0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 -- 172.21.15.77:0/3098388850 shutdown_connections 2024-04-25T13:47:08.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 --2- 172.21.15.77:0/3098388850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 0x7ff05c14dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 --2- 172.21.15.77:0/3098388850 >> v2:172.21.15.96:3300/0 conn(0x7ff05c151fe0 0x7ff05c1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 --2- 172.21.15.77:0/3098388850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 0x7ff05c0a7190 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 -- 172.21.15.77:0/3098388850 >> 172.21.15.77:0/3098388850 conn(0x7ff05c0c02a0 msgr2=0x7ff05c0c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 -- 172.21.15.77:0/3098388850 shutdown_connections 2024-04-25T13:47:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 -- 172.21.15.77:0/3098388850 wait complete. 2024-04-25T13:47:08.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 Processor -- start 2024-04-25T13:47:08.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.618+0000 7ff064236640 1 -- start start 2024-04-25T13:47:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff064236640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 0x7ff05c1e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff064236640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c151fe0 0x7ff05c14d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff064236640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 0x7ff05c145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff064236640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c14e3e0 con 0x7ff05c0a93a0 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff064236640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c0a8510 con 0x7ff05c151fe0 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff064236640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff05c14e560 con 0x7ff05c152930 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff061fd2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 0x7ff05c1e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff061fd2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 0x7ff05c1e7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54948/0 (socket says 172.21.15.77:54948) 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff061fd2640 1 -- 172.21.15.77:0/1671897265 learned_addr learned my addr 172.21.15.77:0/1671897265 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff0617d1640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c151fe0 0x7ff05c14d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff0627d3640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 0x7ff05c145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff061fd2640 1 -- 172.21.15.77:0/1671897265 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 msgr2=0x7ff05c145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff061fd2640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 0x7ff05c145580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff061fd2640 1 -- 172.21.15.77:0/1671897265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c151fe0 msgr2=0x7ff05c14d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff061fd2640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c151fe0 0x7ff05c14d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff061fd2640 1 -- 172.21.15.77:0/1671897265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c1e8240 con 0x7ff05c0a93a0 2024-04-25T13:47:08.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff0617d1640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c151fe0 0x7ff05c14d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff061fd2640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 0x7ff05c1e7d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff05401be60 tx=0x7ff05401a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff05a7fc640 1 -- 172.21.15.77:0/1671897265 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff054005bb0 con 0x7ff05c0a93a0 2024-04-25T13:47:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff05a7fc640 1 -- 172.21.15.77:0/1671897265 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0540bd070 con 0x7ff05c0a93a0 2024-04-25T13:47:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c14a740 con 0x7ff05c0a93a0 2024-04-25T13:47:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff05a7fc640 1 -- 172.21.15.77:0/1671897265 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0540a7890 con 0x7ff05c0a93a0 2024-04-25T13:47:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c14a3d0 con 0x7ff05c0a93a0 2024-04-25T13:47:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05c06a280 con 0x7ff05c0a93a0 2024-04-25T13:47:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff05a7fc640 1 -- 172.21.15.77:0/1671897265 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff0540a7a30 con 0x7ff05c0a93a0 2024-04-25T13:47:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff05a7fc640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff04806f400 0x7ff048071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff0617d1640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff04806f400 0x7ff048071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.622+0000 7ff05a7fc640 1 -- 172.21.15.77:0/1671897265 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ff054129d70 con 0x7ff05c0a93a0 2024-04-25T13:47:08.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.626+0000 7ff0617d1640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff04806f400 0x7ff048071910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0c1f90 tx=0x7ff05000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.630+0000 7ff05a7fc640 1 -- 172.21.15.77:0/1671897265 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff0540174c0 con 0x7ff05c0a93a0 2024-04-25T13:47:08.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.782+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff05c146610 con 0x7ff04806f400 2024-04-25T13:47:08.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.794+0000 7ff05a7fc640 1 -- 172.21.15.77:0/1671897265 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253050 (secure 0 0 0) 0x7ff050009ba0 con 0x7ff04806f400 2024-04-25T13:47:08.798 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:08.801 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff04806f400 msgr2=0x7ff048071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff04806f400 0x7ff048071910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0c1f90 tx=0x7ff05000b040 comp rx=0 tx=0).stop 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 msgr2=0x7ff05c1e7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 0x7ff05c1e7d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff05401be60 tx=0x7ff05401a550 comp rx=0 tx=0).stop 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 shutdown_connections 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff04806f400 0x7ff048071910 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c152930 0x7ff05c145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c151fe0 0x7ff05c14d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 --2- 172.21.15.77:0/1671897265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff05c0a93a0 0x7ff05c1e7d00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 >> 172.21.15.77:0/1671897265 conn(0x7ff05c0c02a0 msgr2=0x7ff05c14e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 shutdown_connections 2024-04-25T13:47:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.798+0000 7ff064236640 1 -- 172.21.15.77:0/1671897265 wait complete. 2024-04-25T13:47:08.817 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-25T13:47:08.512120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76265210,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":371,"num_read_kb":1008,"num_write":10993,"num_write_kb":81620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19805,"ondisk_log_size":19805,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":505072,"kb_used_data":112688,"kb_used_omap":12,"kb_used_meta":392307,"kb_avail":754469648,"statfs":{"total":773094113280,"available":772576919552,"internally_reserved":0,"allocated":115392512,"data_stored":153233412,"data_compressed":10406040,"data_compressed_allocated":20234240,"data_compressed_original":59367424,"omap_allocated":12752,"internal_metadata":401722928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":265,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004232"},"pg_stats":[{"pgid":"3.3f","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.711440+0000","last_change":"2024-04-25T13:41:04.470225+0000","last_active":"2024-04-25T13:47:01.711440+0000","last_peered":"2024-04-25T13:47:01.711440+0000","last_clean":"2024-04-25T13:47:01.711440+0000","last_became_active":"2024-04-25T13:41:04.434108+0000","last_became_peered":"2024-04-25T13:41:04.434108+0000","last_unstale":"2024-04-25T13:47:01.711440+0000","last_undegraded":"2024-04-25T13:47:01.711440+0000","last_fullsized":"2024-04-25T13:47:01.711440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.654910+0000","last_change":"2024-04-25T13:41:04.422886+0000","last_active":"2024-04-25T13:47:01.654910+0000","last_peered":"2024-04-25T13:47:01.654910+0000","last_clean":"2024-04-25T13:47:01.654910+0000","last_became_active":"2024-04-25T13:41:04.422546+0000","last_became_peered":"2024-04-25T13:41:04.422546+0000","last_unstale":"2024-04-25T13:47:01.654910+0000","last_undegraded":"2024-04-25T13:47:01.654910+0000","last_fullsized":"2024-04-25T13:47:01.654910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'65","reported_seq":83,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.694297+0000","last_change":"2024-04-25T13:41:04.413021+0000","last_active":"2024-04-25T13:47:01.694297+0000","last_peered":"2024-04-25T13:47:01.694297+0000","last_clean":"2024-04-25T13:47:01.694297+0000","last_became_active":"2024-04-25T13:41:04.412382+0000","last_became_peered":"2024-04-25T13:41:04.412382+0000","last_unstale":"2024-04-25T13:47:01.694297+0000","last_undegraded":"2024-04-25T13:47:01.694297+0000","last_fullsized":"2024-04-25T13:47:01.694297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706143+0000","last_change":"2024-04-25T13:41:04.419756+0000","last_active":"2024-04-25T13:47:01.706143+0000","last_peered":"2024-04-25T13:47:01.706143+0000","last_clean":"2024-04-25T13:47:01.706143+0000","last_became_active":"2024-04-25T13:41:04.418367+0000","last_became_peered":"2024-04-25T13:41:04.418367+0000","last_unstale":"2024-04-25T13:47:01.706143+0000","last_undegraded":"2024-04-25T13:47:01.706143+0000","last_fullsized":"2024-04-25T13:47:01.706143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'85","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706761+0000","last_change":"2024-04-25T13:41:04.428788+0000","last_active":"2024-04-25T13:47:01.706761+0000","last_peered":"2024-04-25T13:47:01.706761+0000","last_clean":"2024-04-25T13:47:01.706761+0000","last_became_active":"2024-04-25T13:41:04.428424+0000","last_became_peered":"2024-04-25T13:41:04.428424+0000","last_unstale":"2024-04-25T13:47:01.706761+0000","last_undegraded":"2024-04-25T13:47:01.706761+0000","last_fullsized":"2024-04-25T13:47:01.706761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695923+0000","last_change":"2024-04-25T13:41:04.432387+0000","last_active":"2024-04-25T13:47:01.695923+0000","last_peered":"2024-04-25T13:47:01.695923+0000","last_clean":"2024-04-25T13:47:01.695923+0000","last_became_active":"2024-04-25T13:41:04.431971+0000","last_became_peered":"2024-04-25T13:41:04.431971+0000","last_unstale":"2024-04-25T13:47:01.695923+0000","last_undegraded":"2024-04-25T13:47:01.695923+0000","last_fullsized":"2024-04-25T13:47:01.695923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'93","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.712245+0000","last_change":"2024-04-25T13:41:04.473786+0000","last_active":"2024-04-25T13:47:01.712245+0000","last_peered":"2024-04-25T13:47:01.712245+0000","last_clean":"2024-04-25T13:47:01.712245+0000","last_became_active":"2024-04-25T13:41:04.471082+0000","last_became_peered":"2024-04-25T13:41:04.471082+0000","last_unstale":"2024-04-25T13:47:01.712245+0000","last_undegraded":"2024-04-25T13:47:01.712245+0000","last_fullsized":"2024-04-25T13:47:01.712245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.693577+0000","last_change":"2024-04-25T13:41:04.410956+0000","last_active":"2024-04-25T13:47:01.693577+0000","last_peered":"2024-04-25T13:47:01.693577+0000","last_clean":"2024-04-25T13:47:01.693577+0000","last_became_active":"2024-04-25T13:41:04.410665+0000","last_became_peered":"2024-04-25T13:41:04.410665+0000","last_unstale":"2024-04-25T13:47:01.693577+0000","last_undegraded":"2024-04-25T13:47:01.693577+0000","last_fullsized":"2024-04-25T13:47:01.693577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'89","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.709375+0000","last_change":"2024-04-25T13:41:04.470410+0000","last_active":"2024-04-25T13:47:01.709375+0000","last_peered":"2024-04-25T13:47:01.709375+0000","last_clean":"2024-04-25T13:47:01.709375+0000","last_became_active":"2024-04-25T13:41:04.434676+0000","last_became_peered":"2024-04-25T13:41:04.434676+0000","last_unstale":"2024-04-25T13:47:01.709375+0000","last_undegraded":"2024-04-25T13:47:01.709375+0000","last_fullsized":"2024-04-25T13:47:01.709375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'73","reported_seq":90,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689356+0000","last_change":"2024-04-25T13:41:04.417498+0000","last_active":"2024-04-25T13:47:01.689356+0000","last_peered":"2024-04-25T13:47:01.689356+0000","last_clean":"2024-04-25T13:47:01.689356+0000","last_became_active":"2024-04-25T13:41:04.417145+0000","last_became_peered":"2024-04-25T13:41:04.417145+0000","last_unstale":"2024-04-25T13:47:01.689356+0000","last_undegraded":"2024-04-25T13:47:01.689356+0000","last_fullsized":"2024-04-25T13:47:01.689356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'79","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.642001+0000","last_change":"2024-04-25T13:41:04.417324+0000","last_active":"2024-04-25T13:47:01.642001+0000","last_peered":"2024-04-25T13:47:01.642001+0000","last_clean":"2024-04-25T13:47:01.642001+0000","last_became_active":"2024-04-25T13:41:04.416982+0000","last_became_peered":"2024-04-25T13:41:04.416982+0000","last_unstale":"2024-04-25T13:47:01.642001+0000","last_undegraded":"2024-04-25T13:47:01.642001+0000","last_fullsized":"2024-04-25T13:47:01.642001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689067+0000","last_change":"2024-04-25T13:41:04.412869+0000","last_active":"2024-04-25T13:47:01.689067+0000","last_peered":"2024-04-25T13:47:01.689067+0000","last_clean":"2024-04-25T13:47:01.689067+0000","last_became_active":"2024-04-25T13:41:04.412544+0000","last_became_peered":"2024-04-25T13:41:04.412544+0000","last_unstale":"2024-04-25T13:47:01.689067+0000","last_undegraded":"2024-04-25T13:47:01.689067+0000","last_fullsized":"2024-04-25T13:47:01.689067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'84","reported_seq":102,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.694600+0000","last_change":"2024-04-25T13:41:04.412143+0000","last_active":"2024-04-25T13:47:01.694600+0000","last_peered":"2024-04-25T13:47:01.694600+0000","last_clean":"2024-04-25T13:47:01.694600+0000","last_became_active":"2024-04-25T13:41:04.411840+0000","last_became_peered":"2024-04-25T13:41:04.411840+0000","last_unstale":"2024-04-25T13:47:01.694600+0000","last_undegraded":"2024-04-25T13:47:01.694600+0000","last_fullsized":"2024-04-25T13:47:01.694600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'74","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.680358+0000","last_change":"2024-04-25T13:41:04.426859+0000","last_active":"2024-04-25T13:47:01.680358+0000","last_peered":"2024-04-25T13:47:01.680358+0000","last_clean":"2024-04-25T13:47:01.680358+0000","last_became_active":"2024-04-25T13:41:04.426437+0000","last_became_peered":"2024-04-25T13:41:04.426437+0000","last_unstale":"2024-04-25T13:47:01.680358+0000","last_undegraded":"2024-04-25T13:47:01.680358+0000","last_fullsized":"2024-04-25T13:47:01.680358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:21.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'78","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.709114+0000","last_change":"2024-04-25T13:41:04.410712+0000","last_active":"2024-04-25T13:47:01.709114+0000","last_peered":"2024-04-25T13:47:01.709114+0000","last_clean":"2024-04-25T13:47:01.709114+0000","last_became_active":"2024-04-25T13:41:04.410362+0000","last_became_peered":"2024-04-25T13:41:04.410362+0000","last_unstale":"2024-04-25T13:47:01.709114+0000","last_undegraded":"2024-04-25T13:47:01.709114+0000","last_fullsized":"2024-04-25T13:47:01.709114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.697238+0000","last_change":"2024-04-25T13:41:04.429493+0000","last_active":"2024-04-25T13:47:01.697238+0000","last_peered":"2024-04-25T13:47:01.697238+0000","last_clean":"2024-04-25T13:47:01.697238+0000","last_became_active":"2024-04-25T13:41:04.429116+0000","last_became_peered":"2024-04-25T13:41:04.429116+0000","last_unstale":"2024-04-25T13:47:01.697238+0000","last_undegraded":"2024-04-25T13:47:01.697238+0000","last_fullsized":"2024-04-25T13:47:01.697238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702423+0000","last_change":"2024-04-25T13:41:04.431688+0000","last_active":"2024-04-25T13:47:01.702423+0000","last_peered":"2024-04-25T13:47:01.702423+0000","last_clean":"2024-04-25T13:47:01.702423+0000","last_became_active":"2024-04-25T13:41:04.431231+0000","last_became_peered":"2024-04-25T13:41:04.431231+0000","last_unstale":"2024-04-25T13:47:01.702423+0000","last_undegraded":"2024-04-25T13:47:01.702423+0000","last_fullsized":"2024-04-25T13:47:01.702423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'76","reported_seq":94,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.632423+0000","last_change":"2024-04-25T13:41:04.407914+0000","last_active":"2024-04-25T13:47:01.632423+0000","last_peered":"2024-04-25T13:47:01.632423+0000","last_clean":"2024-04-25T13:47:01.632423+0000","last_became_active":"2024-04-25T13:41:04.407553+0000","last_became_peered":"2024-04-25T13:41:04.407553+0000","last_unstale":"2024-04-25T13:47:01.632423+0000","last_undegraded":"2024-04-25T13:47:01.632423+0000","last_fullsized":"2024-04-25T13:47:01.632423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706072+0000","last_change":"2024-04-25T13:41:04.430301+0000","last_active":"2024-04-25T13:47:01.706072+0000","last_peered":"2024-04-25T13:47:01.706072+0000","last_clean":"2024-04-25T13:47:01.706072+0000","last_became_active":"2024-04-25T13:41:04.428597+0000","last_became_peered":"2024-04-25T13:41:04.428597+0000","last_unstale":"2024-04-25T13:47:01.706072+0000","last_undegraded":"2024-04-25T13:47:01.706072+0000","last_fullsized":"2024-04-25T13:47:01.706072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'82","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.684496+0000","last_change":"2024-04-25T13:41:04.423772+0000","last_active":"2024-04-25T13:47:01.684496+0000","last_peered":"2024-04-25T13:47:01.684496+0000","last_clean":"2024-04-25T13:47:01.684496+0000","last_became_active":"2024-04-25T13:41:04.423453+0000","last_became_peered":"2024-04-25T13:41:04.423453+0000","last_unstale":"2024-04-25T13:47:01.684496+0000","last_undegraded":"2024-04-25T13:47:01.684496+0000","last_fullsized":"2024-04-25T13:47:01.684496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'83","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700754+0000","last_change":"2024-04-25T13:41:04.430195+0000","last_active":"2024-04-25T13:47:01.700754+0000","last_peered":"2024-04-25T13:47:01.700754+0000","last_clean":"2024-04-25T13:47:01.700754+0000","last_became_active":"2024-04-25T13:41:04.429917+0000","last_became_peered":"2024-04-25T13:41:04.429917+0000","last_unstale":"2024-04-25T13:47:01.700754+0000","last_undegraded":"2024-04-25T13:47:01.700754+0000","last_fullsized":"2024-04-25T13:47:01.700754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692652+0000","last_change":"2024-04-25T13:41:04.431579+0000","last_active":"2024-04-25T13:47:01.692652+0000","last_peered":"2024-04-25T13:47:01.692652+0000","last_clean":"2024-04-25T13:47:01.692652+0000","last_became_active":"2024-04-25T13:41:04.431160+0000","last_became_peered":"2024-04-25T13:41:04.431160+0000","last_unstale":"2024-04-25T13:47:01.692652+0000","last_undegraded":"2024-04-25T13:47:01.692652+0000","last_fullsized":"2024-04-25T13:47:01.692652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'69","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698369+0000","last_change":"2024-04-25T13:41:04.423185+0000","last_active":"2024-04-25T13:47:01.698369+0000","last_peered":"2024-04-25T13:47:01.698369+0000","last_clean":"2024-04-25T13:47:01.698369+0000","last_became_active":"2024-04-25T13:41:04.422815+0000","last_became_peered":"2024-04-25T13:41:04.422815+0000","last_unstale":"2024-04-25T13:47:01.698369+0000","last_undegraded":"2024-04-25T13:47:01.698369+0000","last_fullsized":"2024-04-25T13:47:01.698369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698911+0000","last_change":"2024-04-25T13:41:04.415522+0000","last_active":"2024-04-25T13:47:01.698911+0000","last_peered":"2024-04-25T13:47:01.698911+0000","last_clean":"2024-04-25T13:47:01.698911+0000","last_became_active":"2024-04-25T13:41:04.414898+0000","last_became_peered":"2024-04-25T13:41:04.414898+0000","last_unstale":"2024-04-25T13:47:01.698911+0000","last_undegraded":"2024-04-25T13:47:01.698911+0000","last_fullsized":"2024-04-25T13:47:01.698911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698454+0000","last_change":"2024-04-25T13:41:04.422142+0000","last_active":"2024-04-25T13:47:01.698454+0000","last_peered":"2024-04-25T13:47:01.698454+0000","last_clean":"2024-04-25T13:47:01.698454+0000","last_became_active":"2024-04-25T13:41:04.421279+0000","last_became_peered":"2024-04-25T13:41:04.421279+0000","last_unstale":"2024-04-25T13:47:01.698454+0000","last_undegraded":"2024-04-25T13:47:01.698454+0000","last_fullsized":"2024-04-25T13:47:01.698454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'98","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.690874+0000","last_change":"2024-04-25T13:41:04.431595+0000","last_active":"2024-04-25T13:47:01.690874+0000","last_peered":"2024-04-25T13:47:01.690874+0000","last_clean":"2024-04-25T13:47:01.690874+0000","last_became_active":"2024-04-25T13:41:04.431130+0000","last_became_peered":"2024-04-25T13:41:04.431130+0000","last_unstale":"2024-04-25T13:47:01.690874+0000","last_undegraded":"2024-04-25T13:47:01.690874+0000","last_fullsized":"2024-04-25T13:47:01.690874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.615396+0000","last_change":"2024-04-25T13:41:04.413732+0000","last_active":"2024-04-25T13:47:01.615396+0000","last_peered":"2024-04-25T13:47:01.615396+0000","last_clean":"2024-04-25T13:47:01.615396+0000","last_became_active":"2024-04-25T13:41:04.413001+0000","last_became_peered":"2024-04-25T13:41:04.413001+0000","last_unstale":"2024-04-25T13:47:01.615396+0000","last_undegraded":"2024-04-25T13:47:01.615396+0000","last_fullsized":"2024-04-25T13:47:01.615396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'61","reported_seq":73,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.676704+0000","last_change":"2024-04-25T13:41:51.580003+0000","last_active":"2024-04-25T13:47:01.676704+0000","last_peered":"2024-04-25T13:47:01.676704+0000","last_clean":"2024-04-25T13:47:01.676704+0000","last_became_active":"2024-04-25T13:41:51.578959+0000","last_became_peered":"2024-04-25T13:41:51.578959+0000","last_unstale":"2024-04-25T13:47:01.676704+0000","last_undegraded":"2024-04-25T13:47:01.676704+0000","last_fullsized":"2024-04-25T13:47:01.676704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704628+0000","last_change":"2024-04-25T13:41:04.423204+0000","last_active":"2024-04-25T13:47:01.704628+0000","last_peered":"2024-04-25T13:47:01.704628+0000","last_clean":"2024-04-25T13:47:01.704628+0000","last_became_active":"2024-04-25T13:41:04.422855+0000","last_became_peered":"2024-04-25T13:41:04.422855+0000","last_unstale":"2024-04-25T13:47:01.704628+0000","last_undegraded":"2024-04-25T13:47:01.704628+0000","last_fullsized":"2024-04-25T13:47:01.704628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'82","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707704+0000","last_change":"2024-04-25T13:41:04.416506+0000","last_active":"2024-04-25T13:47:01.707704+0000","last_peered":"2024-04-25T13:47:01.707704+0000","last_clean":"2024-04-25T13:47:01.707704+0000","last_became_active":"2024-04-25T13:41:04.416177+0000","last_became_peered":"2024-04-25T13:41:04.416177+0000","last_unstale":"2024-04-25T13:47:01.707704+0000","last_undegraded":"2024-04-25T13:47:01.707704+0000","last_fullsized":"2024-04-25T13:47:01.707704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'92","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705522+0000","last_change":"2024-04-25T13:41:51.963280+0000","last_active":"2024-04-25T13:47:01.705522+0000","last_peered":"2024-04-25T13:47:01.705522+0000","last_clean":"2024-04-25T13:47:01.705522+0000","last_became_active":"2024-04-25T13:41:51.962421+0000","last_became_peered":"2024-04-25T13:41:51.962421+0000","last_unstale":"2024-04-25T13:47:01.705522+0000","last_undegraded":"2024-04-25T13:47:01.705522+0000","last_fullsized":"2024-04-25T13:47:01.705522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'82","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695679+0000","last_change":"2024-04-25T13:41:04.430078+0000","last_active":"2024-04-25T13:47:01.695679+0000","last_peered":"2024-04-25T13:47:01.695679+0000","last_clean":"2024-04-25T13:47:01.695679+0000","last_became_active":"2024-04-25T13:41:04.429518+0000","last_became_peered":"2024-04-25T13:41:04.429518+0000","last_unstale":"2024-04-25T13:47:01.695679+0000","last_undegraded":"2024-04-25T13:47:01.695679+0000","last_fullsized":"2024-04-25T13:47:01.695679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'99","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.673373+0000","last_change":"2024-04-25T13:41:04.402158+0000","last_active":"2024-04-25T13:47:01.673373+0000","last_peered":"2024-04-25T13:47:01.673373+0000","last_clean":"2024-04-25T13:47:01.673373+0000","last_became_active":"2024-04-25T13:41:04.401821+0000","last_became_peered":"2024-04-25T13:41:04.401821+0000","last_unstale":"2024-04-25T13:47:01.673373+0000","last_undegraded":"2024-04-25T13:47:01.673373+0000","last_fullsized":"2024-04-25T13:47:01.673373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:18.457935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'881","reported_seq":901,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.561591+0000","last_change":"2024-04-25T13:41:03.425690+0000","last_active":"2024-04-25T13:46:38.561591+0000","last_peered":"2024-04-25T13:46:38.561591+0000","last_clean":"2024-04-25T13:46:38.561591+0000","last_became_active":"2024-04-25T13:41:03.425239+0000","last_became_peered":"2024-04-25T13:41:03.425239+0000","last_unstale":"2024-04-25T13:46:38.561591+0000","last_undegraded":"2024-04-25T13:46:38.561591+0000","last_fullsized":"2024-04-25T13:46:38.561591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'78","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692647+0000","last_change":"2024-04-25T13:41:04.411250+0000","last_active":"2024-04-25T13:47:01.692647+0000","last_peered":"2024-04-25T13:47:01.692647+0000","last_clean":"2024-04-25T13:47:01.692647+0000","last_became_active":"2024-04-25T13:41:04.400223+0000","last_became_peered":"2024-04-25T13:41:04.400223+0000","last_unstale":"2024-04-25T13:47:01.692647+0000","last_undegraded":"2024-04-25T13:47:01.692647+0000","last_fullsized":"2024-04-25T13:47:01.692647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'462","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.568394+0000","last_change":"2024-04-25T13:41:03.435467+0000","last_active":"2024-04-25T13:46:38.568394+0000","last_peered":"2024-04-25T13:46:38.568394+0000","last_clean":"2024-04-25T13:46:38.568394+0000","last_became_active":"2024-04-25T13:41:03.426677+0000","last_became_peered":"2024-04-25T13:41:03.426677+0000","last_unstale":"2024-04-25T13:46:38.568394+0000","last_undegraded":"2024-04-25T13:46:38.568394+0000","last_fullsized":"2024-04-25T13:46:38.568394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":4234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'118","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.118271+0000","last_change":"2024-04-25T13:41:03.437180+0000","last_active":"2024-04-25T13:45:30.118271+0000","last_peered":"2024-04-25T13:45:30.118271+0000","last_clean":"2024-04-25T13:45:30.118271+0000","last_became_active":"2024-04-25T13:41:03.436905+0000","last_became_peered":"2024-04-25T13:41:03.436905+0000","last_unstale":"2024-04-25T13:45:30.118271+0000","last_undegraded":"2024-04-25T13:45:30.118271+0000","last_fullsized":"2024-04-25T13:45:30.118271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706538+0000","last_change":"2024-04-25T13:41:04.423777+0000","last_active":"2024-04-25T13:47:01.706538+0000","last_peered":"2024-04-25T13:47:01.706538+0000","last_clean":"2024-04-25T13:47:01.706538+0000","last_became_active":"2024-04-25T13:41:04.423470+0000","last_became_peered":"2024-04-25T13:41:04.423470+0000","last_unstale":"2024-04-25T13:47:01.706538+0000","last_undegraded":"2024-04-25T13:47:01.706538+0000","last_fullsized":"2024-04-25T13:47:01.706538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'1580","reported_seq":1600,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.604698+0000","last_change":"2024-04-25T13:41:03.445205+0000","last_active":"2024-04-25T13:47:01.604698+0000","last_peered":"2024-04-25T13:47:01.604698+0000","last_clean":"2024-04-25T13:47:01.604698+0000","last_became_active":"2024-04-25T13:41:03.444412+0000","last_became_peered":"2024-04-25T13:41:03.444412+0000","last_unstale":"2024-04-25T13:47:01.604698+0000","last_undegraded":"2024-04-25T13:47:01.604698+0000","last_fullsized":"2024-04-25T13:47:01.604698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1580,"log_dups_size":0,"ondisk_log_size":1580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7794585,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1453,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'89","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704618+0000","last_change":"2024-04-25T13:41:04.413827+0000","last_active":"2024-04-25T13:47:01.704618+0000","last_peered":"2024-04-25T13:47:01.704618+0000","last_clean":"2024-04-25T13:47:01.704618+0000","last_became_active":"2024-04-25T13:41:04.413496+0000","last_became_peered":"2024-04-25T13:41:04.413496+0000","last_unstale":"2024-04-25T13:47:01.704618+0000","last_undegraded":"2024-04-25T13:47:01.704618+0000","last_fullsized":"2024-04-25T13:47:01.704618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'122","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.558831+0000","last_change":"2024-04-25T13:41:03.450428+0000","last_active":"2024-04-25T13:46:38.558831+0000","last_peered":"2024-04-25T13:46:38.558831+0000","last_clean":"2024-04-25T13:46:38.558831+0000","last_became_active":"2024-04-25T13:41:03.449629+0000","last_became_peered":"2024-04-25T13:41:03.449629+0000","last_unstale":"2024-04-25T13:46:38.558831+0000","last_undegraded":"2024-04-25T13:46:38.558831+0000","last_fullsized":"2024-04-25T13:46:38.558831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'92","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705851+0000","last_change":"2024-04-25T13:41:51.584948+0000","last_active":"2024-04-25T13:47:01.705851+0000","last_peered":"2024-04-25T13:47:01.705851+0000","last_clean":"2024-04-25T13:47:01.705851+0000","last_became_active":"2024-04-25T13:41:51.584089+0000","last_became_peered":"2024-04-25T13:41:51.584089+0000","last_unstale":"2024-04-25T13:47:01.705851+0000","last_undegraded":"2024-04-25T13:47:01.705851+0000","last_fullsized":"2024-04-25T13:47:01.705851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'135","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.558766+0000","last_change":"2024-04-25T13:41:03.445209+0000","last_active":"2024-04-25T13:46:38.558766+0000","last_peered":"2024-04-25T13:46:38.558766+0000","last_clean":"2024-04-25T13:46:38.558766+0000","last_became_active":"2024-04-25T13:41:03.444460+0000","last_became_peered":"2024-04-25T13:41:03.444460+0000","last_unstale":"2024-04-25T13:46:38.558766+0000","last_undegraded":"2024-04-25T13:46:38.558766+0000","last_fullsized":"2024-04-25T13:46:38.558766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.691986+0000","last_change":"2024-04-25T13:41:04.423661+0000","last_active":"2024-04-25T13:47:01.691986+0000","last_peered":"2024-04-25T13:47:01.691986+0000","last_clean":"2024-04-25T13:47:01.691986+0000","last_became_active":"2024-04-25T13:41:04.421991+0000","last_became_peered":"2024-04-25T13:41:04.421991+0000","last_unstale":"2024-04-25T13:47:01.691986+0000","last_undegraded":"2024-04-25T13:47:01.691986+0000","last_fullsized":"2024-04-25T13:47:01.691986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'242","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.574192+0000","last_change":"2024-04-25T13:41:03.443960+0000","last_active":"2024-04-25T13:46:38.574192+0000","last_peered":"2024-04-25T13:46:38.574192+0000","last_clean":"2024-04-25T13:46:38.574192+0000","last_became_active":"2024-04-25T13:41:03.443721+0000","last_became_peered":"2024-04-25T13:41:03.443721+0000","last_unstale":"2024-04-25T13:46:38.574192+0000","last_undegraded":"2024-04-25T13:46:38.574192+0000","last_fullsized":"2024-04-25T13:46:38.574192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700376+0000","last_change":"2024-04-25T13:41:04.423896+0000","last_active":"2024-04-25T13:47:01.700376+0000","last_peered":"2024-04-25T13:47:01.700376+0000","last_clean":"2024-04-25T13:47:01.700376+0000","last_became_active":"2024-04-25T13:41:04.423569+0000","last_became_peered":"2024-04-25T13:41:04.423569+0000","last_unstale":"2024-04-25T13:47:01.700376+0000","last_undegraded":"2024-04-25T13:47:01.700376+0000","last_fullsized":"2024-04-25T13:47:01.700376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'558","reported_seq":577,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.569179+0000","last_change":"2024-04-25T13:41:03.426055+0000","last_active":"2024-04-25T13:46:38.569179+0000","last_peered":"2024-04-25T13:46:38.569179+0000","last_clean":"2024-04-25T13:46:38.569179+0000","last_became_active":"2024-04-25T13:41:03.424990+0000","last_became_peered":"2024-04-25T13:41:03.424990+0000","last_unstale":"2024-04-25T13:46:38.569179+0000","last_undegraded":"2024-04-25T13:46:38.569179+0000","last_fullsized":"2024-04-25T13:46:38.569179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'65","reported_seq":83,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700984+0000","last_change":"2024-04-25T13:41:04.430564+0000","last_active":"2024-04-25T13:47:01.700984+0000","last_peered":"2024-04-25T13:47:01.700984+0000","last_clean":"2024-04-25T13:47:01.700984+0000","last_became_active":"2024-04-25T13:41:04.427802+0000","last_became_peered":"2024-04-25T13:41:04.427802+0000","last_unstale":"2024-04-25T13:47:01.700984+0000","last_undegraded":"2024-04-25T13:47:01.700984+0000","last_fullsized":"2024-04-25T13:47:01.700984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'1525","reported_seq":1545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.553532+0000","last_change":"2024-04-25T13:41:03.422851+0000","last_active":"2024-04-25T13:46:38.553532+0000","last_peered":"2024-04-25T13:46:38.553532+0000","last_clean":"2024-04-25T13:46:38.553532+0000","last_became_active":"2024-04-25T13:41:03.422529+0000","last_became_peered":"2024-04-25T13:41:03.422529+0000","last_unstale":"2024-04-25T13:46:38.553532+0000","last_undegraded":"2024-04-25T13:46:38.553532+0000","last_fullsized":"2024-04-25T13:46:38.553532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1414,"num_write_kb":8966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689666+0000","last_change":"2024-04-25T13:41:04.429077+0000","last_active":"2024-04-25T13:47:01.689666+0000","last_peered":"2024-04-25T13:47:01.689666+0000","last_clean":"2024-04-25T13:47:01.689666+0000","last_became_active":"2024-04-25T13:41:04.428641+0000","last_became_peered":"2024-04-25T13:41:04.428641+0000","last_unstale":"2024-04-25T13:47:01.689666+0000","last_undegraded":"2024-04-25T13:47:01.689666+0000","last_fullsized":"2024-04-25T13:47:01.689666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'125","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.555214+0000","last_change":"2024-04-25T13:41:03.450649+0000","last_active":"2024-04-25T13:46:39.555214+0000","last_peered":"2024-04-25T13:46:39.555214+0000","last_clean":"2024-04-25T13:46:39.555214+0000","last_became_active":"2024-04-25T13:41:03.449872+0000","last_became_peered":"2024-04-25T13:41:03.449872+0000","last_unstale":"2024-04-25T13:46:39.555214+0000","last_undegraded":"2024-04-25T13:46:39.555214+0000","last_fullsized":"2024-04-25T13:46:39.555214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'85","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.677702+0000","last_change":"2024-04-25T13:41:51.580092+0000","last_active":"2024-04-25T13:47:01.677702+0000","last_peered":"2024-04-25T13:47:01.677702+0000","last_clean":"2024-04-25T13:47:01.677702+0000","last_became_active":"2024-04-25T13:41:51.578950+0000","last_became_peered":"2024-04-25T13:41:51.578950+0000","last_unstale":"2024-04-25T13:47:01.677702+0000","last_undegraded":"2024-04-25T13:47:01.677702+0000","last_fullsized":"2024-04-25T13:47:01.677702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"23'124","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:42.457078+0000","last_change":"2024-04-25T13:41:03.423826+0000","last_active":"2024-04-25T13:45:42.457078+0000","last_peered":"2024-04-25T13:45:42.457078+0000","last_clean":"2024-04-25T13:45:42.457078+0000","last_became_active":"2024-04-25T13:41:03.423037+0000","last_became_peered":"2024-04-25T13:41:03.423037+0000","last_unstale":"2024-04-25T13:45:42.457078+0000","last_undegraded":"2024-04-25T13:45:42.457078+0000","last_fullsized":"2024-04-25T13:45:42.457078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'91","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695393+0000","last_change":"2024-04-25T13:41:04.429831+0000","last_active":"2024-04-25T13:47:01.695393+0000","last_peered":"2024-04-25T13:47:01.695393+0000","last_clean":"2024-04-25T13:47:01.695393+0000","last_became_active":"2024-04-25T13:41:04.429110+0000","last_became_peered":"2024-04-25T13:41:04.429110+0000","last_unstale":"2024-04-25T13:47:01.695393+0000","last_undegraded":"2024-04-25T13:47:01.695393+0000","last_fullsized":"2024-04-25T13:47:01.695393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'134","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:42.452354+0000","last_change":"2024-04-25T13:41:03.409148+0000","last_active":"2024-04-25T13:45:42.452354+0000","last_peered":"2024-04-25T13:45:42.452354+0000","last_clean":"2024-04-25T13:45:42.452354+0000","last_became_active":"2024-04-25T13:41:03.408414+0000","last_became_peered":"2024-04-25T13:41:03.408414+0000","last_unstale":"2024-04-25T13:45:42.452354+0000","last_undegraded":"2024-04-25T13:45:42.452354+0000","last_fullsized":"2024-04-25T13:45:42.452354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'94","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707955+0000","last_change":"2024-04-25T13:41:04.426477+0000","last_active":"2024-04-25T13:47:01.707955+0000","last_peered":"2024-04-25T13:47:01.707955+0000","last_clean":"2024-04-25T13:47:01.707955+0000","last_became_active":"2024-04-25T13:41:04.425891+0000","last_became_peered":"2024-04-25T13:41:04.425891+0000","last_unstale":"2024-04-25T13:47:01.707955+0000","last_undegraded":"2024-04-25T13:47:01.707955+0000","last_fullsized":"2024-04-25T13:47:01.707955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'118","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.571270+0000","last_change":"2024-04-25T13:41:03.421716+0000","last_active":"2024-04-25T13:46:38.571270+0000","last_peered":"2024-04-25T13:46:38.571270+0000","last_clean":"2024-04-25T13:46:38.571270+0000","last_became_active":"2024-04-25T13:41:03.420848+0000","last_became_peered":"2024-04-25T13:41:03.420848+0000","last_unstale":"2024-04-25T13:46:38.571270+0000","last_undegraded":"2024-04-25T13:46:38.571270+0000","last_fullsized":"2024-04-25T13:46:38.571270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.389116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706476+0000","last_change":"2024-04-25T13:41:04.429840+0000","last_active":"2024-04-25T13:47:01.706476+0000","last_peered":"2024-04-25T13:47:01.706476+0000","last_clean":"2024-04-25T13:47:01.706476+0000","last_became_active":"2024-04-25T13:41:04.429404+0000","last_became_peered":"2024-04-25T13:41:04.429404+0000","last_unstale":"2024-04-25T13:47:01.706476+0000","last_undegraded":"2024-04-25T13:47:01.706476+0000","last_fullsized":"2024-04-25T13:47:01.706476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'106","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:32.450719+0000","last_change":"2024-04-25T13:41:03.415723+0000","last_active":"2024-04-25T13:45:32.450719+0000","last_peered":"2024-04-25T13:45:32.450719+0000","last_clean":"2024-04-25T13:45:32.450719+0000","last_became_active":"2024-04-25T13:41:03.414957+0000","last_became_peered":"2024-04-25T13:41:03.414957+0000","last_unstale":"2024-04-25T13:45:32.450719+0000","last_undegraded":"2024-04-25T13:45:32.450719+0000","last_fullsized":"2024-04-25T13:45:32.450719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.708064+0000","last_change":"2024-04-25T13:41:04.434675+0000","last_active":"2024-04-25T13:47:01.708064+0000","last_peered":"2024-04-25T13:47:01.708064+0000","last_clean":"2024-04-25T13:47:01.708064+0000","last_became_active":"2024-04-25T13:41:04.434194+0000","last_became_peered":"2024-04-25T13:41:04.434194+0000","last_unstale":"2024-04-25T13:47:01.708064+0000","last_undegraded":"2024-04-25T13:47:01.708064+0000","last_fullsized":"2024-04-25T13:47:01.708064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'576","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.554602+0000","last_change":"2024-04-25T13:41:03.402131+0000","last_active":"2024-04-25T13:46:38.554602+0000","last_peered":"2024-04-25T13:46:38.554602+0000","last_clean":"2024-04-25T13:46:38.554602+0000","last_became_active":"2024-04-25T13:41:03.401398+0000","last_became_peered":"2024-04-25T13:41:03.401398+0000","last_unstale":"2024-04-25T13:46:38.554602+0000","last_undegraded":"2024-04-25T13:46:38.554602+0000","last_fullsized":"2024-04-25T13:46:38.554602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":4320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'92","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704161+0000","last_change":"2024-04-25T13:41:04.418743+0000","last_active":"2024-04-25T13:47:01.704161+0000","last_peered":"2024-04-25T13:47:01.704161+0000","last_clean":"2024-04-25T13:47:01.704161+0000","last_became_active":"2024-04-25T13:41:04.417963+0000","last_became_peered":"2024-04-25T13:41:04.417963+0000","last_unstale":"2024-04-25T13:47:01.704161+0000","last_undegraded":"2024-04-25T13:47:01.704161+0000","last_fullsized":"2024-04-25T13:47:01.704161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'134","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:32.450666+0000","last_change":"2024-04-25T13:41:03.445729+0000","last_active":"2024-04-25T13:45:32.450666+0000","last_peered":"2024-04-25T13:45:32.450666+0000","last_clean":"2024-04-25T13:45:32.450666+0000","last_became_active":"2024-04-25T13:41:03.445293+0000","last_became_peered":"2024-04-25T13:41:03.445293+0000","last_unstale":"2024-04-25T13:45:32.450666+0000","last_undegraded":"2024-04-25T13:45:32.450666+0000","last_fullsized":"2024-04-25T13:45:32.450666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'92","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707261+0000","last_change":"2024-04-25T13:41:51.966509+0000","last_active":"2024-04-25T13:47:01.707261+0000","last_peered":"2024-04-25T13:47:01.707261+0000","last_clean":"2024-04-25T13:47:01.707261+0000","last_became_active":"2024-04-25T13:41:51.965867+0000","last_became_peered":"2024-04-25T13:41:51.965867+0000","last_unstale":"2024-04-25T13:47:01.707261+0000","last_undegraded":"2024-04-25T13:47:01.707261+0000","last_fullsized":"2024-04-25T13:47:01.707261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:14.462796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:02.451274+0000","last_change":"2024-04-25T13:41:00.175142+0000","last_active":"2024-04-25T13:45:02.451274+0000","last_peered":"2024-04-25T13:45:02.451274+0000","last_clean":"2024-04-25T13:45:02.451274+0000","last_became_active":"2024-04-25T13:41:00.172906+0000","last_became_peered":"2024-04-25T13:41:00.172906+0000","last_unstale":"2024-04-25T13:45:02.451274+0000","last_undegraded":"2024-04-25T13:45:02.451274+0000","last_fullsized":"2024-04-25T13:45:02.451274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_clean_scrub_stamp":"2024-04-25T13:40:59.093070+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:38.020124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'122","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.560972+0000","last_change":"2024-04-25T13:41:03.438420+0000","last_active":"2024-04-25T13:46:39.560972+0000","last_peered":"2024-04-25T13:46:39.560972+0000","last_clean":"2024-04-25T13:46:39.560972+0000","last_became_active":"2024-04-25T13:41:03.437569+0000","last_became_peered":"2024-04-25T13:41:03.437569+0000","last_unstale":"2024-04-25T13:46:39.560972+0000","last_undegraded":"2024-04-25T13:46:39.560972+0000","last_fullsized":"2024-04-25T13:46:39.560972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.703768+0000","last_change":"2024-04-25T13:41:04.417328+0000","last_active":"2024-04-25T13:47:01.703768+0000","last_peered":"2024-04-25T13:47:01.703768+0000","last_clean":"2024-04-25T13:47:01.703768+0000","last_became_active":"2024-04-25T13:41:04.416666+0000","last_became_peered":"2024-04-25T13:41:04.416666+0000","last_unstale":"2024-04-25T13:47:01.703768+0000","last_undegraded":"2024-04-25T13:47:01.703768+0000","last_fullsized":"2024-04-25T13:47:01.703768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'1393","reported_seq":1414,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.567347+0000","last_change":"2024-04-25T13:41:03.431855+0000","last_active":"2024-04-25T13:46:38.567347+0000","last_peered":"2024-04-25T13:46:38.567347+0000","last_clean":"2024-04-25T13:46:38.567347+0000","last_became_active":"2024-04-25T13:41:03.429200+0000","last_became_peered":"2024-04-25T13:41:03.429200+0000","last_unstale":"2024-04-25T13:46:38.567347+0000","last_undegraded":"2024-04-25T13:46:38.567347+0000","last_fullsized":"2024-04-25T13:46:38.567347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1393,"log_dups_size":0,"ondisk_log_size":1393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1260,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.672770+0000","last_change":"2024-04-25T13:41:04.411548+0000","last_active":"2024-04-25T13:47:01.672770+0000","last_peered":"2024-04-25T13:47:01.672770+0000","last_clean":"2024-04-25T13:47:01.672770+0000","last_became_active":"2024-04-25T13:41:04.400093+0000","last_became_peered":"2024-04-25T13:41:04.400093+0000","last_unstale":"2024-04-25T13:47:01.672770+0000","last_undegraded":"2024-04-25T13:47:01.672770+0000","last_fullsized":"2024-04-25T13:47:01.672770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:09.999429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'425","reported_seq":750,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.545454+0000","last_change":"2024-04-25T13:41:03.415949+0000","last_active":"2024-04-25T13:46:39.545454+0000","last_peered":"2024-04-25T13:46:39.545454+0000","last_clean":"2024-04-25T13:46:39.545454+0000","last_became_active":"2024-04-25T13:41:03.414899+0000","last_became_peered":"2024-04-25T13:41:03.414899+0000","last_unstale":"2024-04-25T13:46:39.545454+0000","last_undegraded":"2024-04-25T13:46:39.545454+0000","last_fullsized":"2024-04-25T13:46:39.545454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":769923,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":305,"num_write_kb":953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'94","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698710+0000","last_change":"2024-04-25T13:41:04.403032+0000","last_active":"2024-04-25T13:47:01.698710+0000","last_peered":"2024-04-25T13:47:01.698710+0000","last_clean":"2024-04-25T13:47:01.698710+0000","last_became_active":"2024-04-25T13:41:04.402055+0000","last_became_peered":"2024-04-25T13:41:04.402055+0000","last_unstale":"2024-04-25T13:47:01.698710+0000","last_undegraded":"2024-04-25T13:47:01.698710+0000","last_fullsized":"2024-04-25T13:47:01.698710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1421","reported_seq":1441,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.572981+0000","last_change":"2024-04-25T13:41:03.447547+0000","last_active":"2024-04-25T13:46:38.572981+0000","last_peered":"2024-04-25T13:46:38.572981+0000","last_clean":"2024-04-25T13:46:38.572981+0000","last_became_active":"2024-04-25T13:41:03.444429+0000","last_became_peered":"2024-04-25T13:41:03.444429+0000","last_unstale":"2024-04-25T13:46:38.572981+0000","last_undegraded":"2024-04-25T13:46:38.572981+0000","last_fullsized":"2024-04-25T13:46:38.572981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1421,"log_dups_size":0,"ondisk_log_size":1421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.667955+0000","last_change":"2024-04-25T13:41:04.398647+0000","last_active":"2024-04-25T13:47:01.667955+0000","last_peered":"2024-04-25T13:47:01.667955+0000","last_clean":"2024-04-25T13:47:01.667955+0000","last_became_active":"2024-04-25T13:41:04.398287+0000","last_became_peered":"2024-04-25T13:41:04.398287+0000","last_unstale":"2024-04-25T13:47:01.667955+0000","last_undegraded":"2024-04-25T13:47:01.667955+0000","last_fullsized":"2024-04-25T13:47:01.667955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:06.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'115","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.107845+0000","last_change":"2024-04-25T13:41:03.414535+0000","last_active":"2024-04-25T13:45:30.107845+0000","last_peered":"2024-04-25T13:45:30.107845+0000","last_clean":"2024-04-25T13:45:30.107845+0000","last_became_active":"2024-04-25T13:41:03.414145+0000","last_became_peered":"2024-04-25T13:41:03.414145+0000","last_unstale":"2024-04-25T13:45:30.107845+0000","last_undegraded":"2024-04-25T13:45:30.107845+0000","last_fullsized":"2024-04-25T13:45:30.107845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'92","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.703641+0000","last_change":"2024-04-25T13:41:04.419186+0000","last_active":"2024-04-25T13:47:01.703641+0000","last_peered":"2024-04-25T13:47:01.703641+0000","last_clean":"2024-04-25T13:47:01.703641+0000","last_became_active":"2024-04-25T13:41:04.417831+0000","last_became_peered":"2024-04-25T13:41:04.417831+0000","last_unstale":"2024-04-25T13:47:01.703641+0000","last_undegraded":"2024-04-25T13:47:01.703641+0000","last_fullsized":"2024-04-25T13:47:01.703641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'105","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.560065+0000","last_change":"2024-04-25T13:41:03.424206+0000","last_active":"2024-04-25T13:46:38.560065+0000","last_peered":"2024-04-25T13:46:38.560065+0000","last_clean":"2024-04-25T13:46:38.560065+0000","last_became_active":"2024-04-25T13:41:03.423176+0000","last_became_peered":"2024-04-25T13:41:03.423176+0000","last_unstale":"2024-04-25T13:46:38.560065+0000","last_undegraded":"2024-04-25T13:46:38.560065+0000","last_fullsized":"2024-04-25T13:46:38.560065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:23.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'78","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.697730+0000","last_change":"2024-04-25T13:41:04.402353+0000","last_active":"2024-04-25T13:47:01.697730+0000","last_peered":"2024-04-25T13:47:01.697730+0000","last_clean":"2024-04-25T13:47:01.697730+0000","last_became_active":"2024-04-25T13:41:04.402014+0000","last_became_peered":"2024-04-25T13:41:04.402014+0000","last_unstale":"2024-04-25T13:47:01.697730+0000","last_undegraded":"2024-04-25T13:47:01.697730+0000","last_fullsized":"2024-04-25T13:47:01.697730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'358","reported_seq":378,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:42.615289+0000","last_change":"2024-04-25T13:41:03.439449+0000","last_active":"2024-04-25T13:46:42.615289+0000","last_peered":"2024-04-25T13:46:42.615289+0000","last_clean":"2024-04-25T13:46:42.615289+0000","last_became_active":"2024-04-25T13:41:03.439074+0000","last_became_peered":"2024-04-25T13:41:03.439074+0000","last_unstale":"2024-04-25T13:46:42.615289+0000","last_undegraded":"2024-04-25T13:46:42.615289+0000","last_fullsized":"2024-04-25T13:46:42.615289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.699026+0000","last_change":"2024-04-25T13:41:04.418630+0000","last_active":"2024-04-25T13:47:01.699026+0000","last_peered":"2024-04-25T13:47:01.699026+0000","last_clean":"2024-04-25T13:47:01.699026+0000","last_became_active":"2024-04-25T13:41:04.418330+0000","last_became_peered":"2024-04-25T13:41:04.418330+0000","last_unstale":"2024-04-25T13:47:01.699026+0000","last_undegraded":"2024-04-25T13:47:01.699026+0000","last_fullsized":"2024-04-25T13:47:01.699026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'120","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.106212+0000","last_change":"2024-04-25T13:41:03.435851+0000","last_active":"2024-04-25T13:45:30.106212+0000","last_peered":"2024-04-25T13:45:30.106212+0000","last_clean":"2024-04-25T13:45:30.106212+0000","last_became_active":"2024-04-25T13:41:03.434870+0000","last_became_peered":"2024-04-25T13:41:03.434870+0000","last_unstale":"2024-04-25T13:45:30.106212+0000","last_undegraded":"2024-04-25T13:45:30.106212+0000","last_fullsized":"2024-04-25T13:45:30.106212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705633+0000","last_change":"2024-04-25T13:41:04.426962+0000","last_active":"2024-04-25T13:47:01.705633+0000","last_peered":"2024-04-25T13:47:01.705633+0000","last_clean":"2024-04-25T13:47:01.705633+0000","last_became_active":"2024-04-25T13:41:04.426424+0000","last_became_peered":"2024-04-25T13:41:04.426424+0000","last_unstale":"2024-04-25T13:47:01.705633+0000","last_undegraded":"2024-04-25T13:47:01.705633+0000","last_fullsized":"2024-04-25T13:47:01.705633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'654","reported_seq":674,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.565821+0000","last_change":"2024-04-25T13:41:03.430095+0000","last_active":"2024-04-25T13:46:38.565821+0000","last_peered":"2024-04-25T13:46:38.565821+0000","last_clean":"2024-04-25T13:46:38.565821+0000","last_became_active":"2024-04-25T13:41:03.429094+0000","last_became_peered":"2024-04-25T13:41:03.429094+0000","last_unstale":"2024-04-25T13:46:38.565821+0000","last_undegraded":"2024-04-25T13:46:38.565821+0000","last_fullsized":"2024-04-25T13:46:38.565821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'81","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.679923+0000","last_change":"2024-04-25T13:41:04.413097+0000","last_active":"2024-04-25T13:47:01.679923+0000","last_peered":"2024-04-25T13:47:01.679923+0000","last_clean":"2024-04-25T13:47:01.679923+0000","last_became_active":"2024-04-25T13:41:04.412572+0000","last_became_peered":"2024-04-25T13:41:04.412572+0000","last_unstale":"2024-04-25T13:47:01.679923+0000","last_undegraded":"2024-04-25T13:47:01.679923+0000","last_fullsized":"2024-04-25T13:47:01.679923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:50.740570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'126","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.557989+0000","last_change":"2024-04-25T13:41:03.411890+0000","last_active":"2024-04-25T13:46:38.557989+0000","last_peered":"2024-04-25T13:46:38.557989+0000","last_clean":"2024-04-25T13:46:38.557989+0000","last_became_active":"2024-04-25T13:41:03.411481+0000","last_became_peered":"2024-04-25T13:41:03.411481+0000","last_unstale":"2024-04-25T13:46:38.557989+0000","last_undegraded":"2024-04-25T13:46:38.557989+0000","last_fullsized":"2024-04-25T13:46:38.557989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'90","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702621+0000","last_change":"2024-04-25T13:41:04.408896+0000","last_active":"2024-04-25T13:47:01.702621+0000","last_peered":"2024-04-25T13:47:01.702621+0000","last_clean":"2024-04-25T13:47:01.702621+0000","last_became_active":"2024-04-25T13:41:04.408517+0000","last_became_peered":"2024-04-25T13:41:04.408517+0000","last_unstale":"2024-04-25T13:47:01.702621+0000","last_undegraded":"2024-04-25T13:47:01.702621+0000","last_fullsized":"2024-04-25T13:47:01.702621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'128","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:34.111762+0000","last_change":"2024-04-25T13:41:03.408129+0000","last_active":"2024-04-25T13:45:34.111762+0000","last_peered":"2024-04-25T13:45:34.111762+0000","last_clean":"2024-04-25T13:45:34.111762+0000","last_became_active":"2024-04-25T13:41:03.407713+0000","last_became_peered":"2024-04-25T13:41:03.407713+0000","last_unstale":"2024-04-25T13:45:34.111762+0000","last_undegraded":"2024-04-25T13:45:34.111762+0000","last_fullsized":"2024-04-25T13:45:34.111762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'94","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702570+0000","last_change":"2024-04-25T13:41:04.424601+0000","last_active":"2024-04-25T13:47:01.702570+0000","last_peered":"2024-04-25T13:47:01.702570+0000","last_clean":"2024-04-25T13:47:01.702570+0000","last_became_active":"2024-04-25T13:41:04.424153+0000","last_became_peered":"2024-04-25T13:41:04.424153+0000","last_unstale":"2024-04-25T13:47:01.702570+0000","last_undegraded":"2024-04-25T13:47:01.702570+0000","last_fullsized":"2024-04-25T13:47:01.702570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'576","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.562196+0000","last_change":"2024-04-25T13:41:03.431525+0000","last_active":"2024-04-25T13:46:39.562196+0000","last_peered":"2024-04-25T13:46:39.562196+0000","last_clean":"2024-04-25T13:46:39.562196+0000","last_became_active":"2024-04-25T13:41:03.430716+0000","last_became_peered":"2024-04-25T13:41:03.430716+0000","last_unstale":"2024-04-25T13:46:39.562196+0000","last_undegraded":"2024-04-25T13:46:39.562196+0000","last_fullsized":"2024-04-25T13:46:39.562196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:46.480379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'75","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.675680+0000","last_change":"2024-04-25T13:41:04.424614+0000","last_active":"2024-04-25T13:47:01.675680+0000","last_peered":"2024-04-25T13:47:01.675680+0000","last_clean":"2024-04-25T13:47:01.675680+0000","last_became_active":"2024-04-25T13:41:04.424248+0000","last_became_peered":"2024-04-25T13:41:04.424248+0000","last_unstale":"2024-04-25T13:47:01.675680+0000","last_undegraded":"2024-04-25T13:47:01.675680+0000","last_fullsized":"2024-04-25T13:47:01.675680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.682341+0000","last_change":"2024-04-25T13:41:04.425893+0000","last_active":"2024-04-25T13:47:01.682341+0000","last_peered":"2024-04-25T13:47:01.682341+0000","last_clean":"2024-04-25T13:47:01.682341+0000","last_became_active":"2024-04-25T13:41:04.424475+0000","last_became_peered":"2024-04-25T13:41:04.424475+0000","last_unstale":"2024-04-25T13:47:01.682341+0000","last_undegraded":"2024-04-25T13:47:01.682341+0000","last_fullsized":"2024-04-25T13:47:01.682341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'113","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.560700+0000","last_change":"2024-04-25T13:41:03.447296+0000","last_active":"2024-04-25T13:46:39.560700+0000","last_peered":"2024-04-25T13:46:39.560700+0000","last_clean":"2024-04-25T13:46:39.560700+0000","last_became_active":"2024-04-25T13:41:03.446522+0000","last_became_peered":"2024-04-25T13:41:03.446522+0000","last_unstale":"2024-04-25T13:46:39.560700+0000","last_undegraded":"2024-04-25T13:46:39.560700+0000","last_fullsized":"2024-04-25T13:46:39.560700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'74","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692806+0000","last_change":"2024-04-25T13:41:04.424211+0000","last_active":"2024-04-25T13:47:01.692806+0000","last_peered":"2024-04-25T13:47:01.692806+0000","last_clean":"2024-04-25T13:47:01.692806+0000","last_became_active":"2024-04-25T13:41:04.423899+0000","last_became_peered":"2024-04-25T13:41:04.423899+0000","last_unstale":"2024-04-25T13:47:01.692806+0000","last_undegraded":"2024-04-25T13:47:01.692806+0000","last_fullsized":"2024-04-25T13:47:01.692806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'992","reported_seq":1012,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.571565+0000","last_change":"2024-04-25T13:41:03.441717+0000","last_active":"2024-04-25T13:46:38.571565+0000","last_peered":"2024-04-25T13:46:38.571565+0000","last_clean":"2024-04-25T13:46:38.571565+0000","last_became_active":"2024-04-25T13:41:03.440886+0000","last_became_peered":"2024-04-25T13:41:03.440886+0000","last_unstale":"2024-04-25T13:46:38.571565+0000","last_undegraded":"2024-04-25T13:46:38.571565+0000","last_fullsized":"2024-04-25T13:46:38.571565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":8413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'76","reported_seq":94,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.691789+0000","last_change":"2024-04-25T13:41:04.423577+0000","last_active":"2024-04-25T13:47:01.691789+0000","last_peered":"2024-04-25T13:47:01.691789+0000","last_clean":"2024-04-25T13:47:01.691789+0000","last_became_active":"2024-04-25T13:41:04.422496+0000","last_became_peered":"2024-04-25T13:41:04.422496+0000","last_unstale":"2024-04-25T13:47:01.691789+0000","last_undegraded":"2024-04-25T13:47:01.691789+0000","last_fullsized":"2024-04-25T13:47:01.691789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'430","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.550665+0000","last_change":"2024-04-25T13:41:03.418067+0000","last_active":"2024-04-25T13:46:39.550665+0000","last_peered":"2024-04-25T13:46:39.550665+0000","last_clean":"2024-04-25T13:46:39.550665+0000","last_became_active":"2024-04-25T13:41:03.417592+0000","last_became_peered":"2024-04-25T13:41:03.417592+0000","last_unstale":"2024-04-25T13:46:39.550665+0000","last_undegraded":"2024-04-25T13:46:39.550665+0000","last_fullsized":"2024-04-25T13:46:39.550665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'82","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.693266+0000","last_change":"2024-04-25T13:41:04.410387+0000","last_active":"2024-04-25T13:47:01.693266+0000","last_peered":"2024-04-25T13:47:01.693266+0000","last_clean":"2024-04-25T13:47:01.693266+0000","last_became_active":"2024-04-25T13:41:04.410065+0000","last_became_peered":"2024-04-25T13:41:04.410065+0000","last_unstale":"2024-04-25T13:47:01.693266+0000","last_undegraded":"2024-04-25T13:47:01.693266+0000","last_fullsized":"2024-04-25T13:47:01.693266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'435","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.107587+0000","last_change":"2024-04-25T13:41:03.425103+0000","last_active":"2024-04-25T13:45:30.107587+0000","last_peered":"2024-04-25T13:45:30.107587+0000","last_clean":"2024-04-25T13:45:30.107587+0000","last_became_active":"2024-04-25T13:41:03.424688+0000","last_became_peered":"2024-04-25T13:41:03.424688+0000","last_unstale":"2024-04-25T13:45:30.107587+0000","last_undegraded":"2024-04-25T13:45:30.107587+0000","last_fullsized":"2024-04-25T13:45:30.107587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:51.359222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75674842,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":10892,"num_write_kb":79992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113328128,"data_stored":151349684,"data_compressed":10339548,"data_compressed_allocated":20144128,"data_compressed_original":58220544,"omap_allocated":0,"internal_metadata":0},"log_size":14453,"ondisk_log_size":14453,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95428,"kb_used_data":23996,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276412,"statfs":{"total":96636764160,"available":96539045888,"internally_reserved":0,"allocated":24571904,"data_stored":34233256,"data_compressed":2467561,"data_compressed_allocated":4726784,"data_compressed_original":14548992,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50572,"kb_used_data":11076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321268,"statfs":{"total":96636764160,"available":96584978432,"internally_reserved":0,"allocated":11341824,"data_stored":16865762,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58792,"kb_used_data":13728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94313048,"statfs":{"total":96636764160,"available":96576561152,"internally_reserved":0,"allocated":14057472,"data_stored":16271157,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89060,"kb_used_data":21788,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94282780,"statfs":{"total":96636764160,"available":96545566720,"internally_reserved":0,"allocated":22310912,"data_stored":28854105,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":10256384,"data_stored":13441381,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":857797,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65576,"kb_used_data":16352,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94306264,"statfs":{"total":96636764160,"available":96569614336,"internally_reserved":0,"allocated":16744448,"data_stored":21059554,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":14784,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":15138816,"data_stored":21650400,"data_compressed":1741521,"data_compressed_allocated":3354624,"data_compressed_original":10035200,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":20972158,"data_compressed":1708275,"data_compressed_allocated":3309568,"data_compressed_original":9461760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16502784,"data_stored":20971680,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":769923,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":13353507,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":28766231,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13815808,"data_stored":16183283,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11100160,"data_stored":16777888,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24264704,"data_stored":33555014,"data_compressed":2434315,"data_compressed_allocated":4681728,"data_compressed_original":13975552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:47:08.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:47:08.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff683160640 1 Processor -- start 2024-04-25T13:47:08.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff683160640 1 -- start start 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff683160640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff67c155850 0x7ff67c071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff683160640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff67c1517b0 0x7ff67c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff683160640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67c152100 con 0x7ff67c06f370 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff683160640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff67c0a4fb0 con 0x7ff67c155850 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff683160640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff67c0c4350 con 0x7ff67c1517b0 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff67bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff67c155850 0x7ff67c071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff67bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff67c155850 0x7ff67c071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54960/0 (socket says 172.21.15.77:54960) 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff680efc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff67c06f370 0x7ff67c0c6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55268/0 (socket says 172.21.15.77:55268) 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff67bfff640 1 -- 172.21.15.77:0/519207073 learned_addr learned my addr 172.21.15.77:0/519207073 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff6816fd640 1 --2- 172.21.15.77:0/519207073 >> v2:172.21.15.96:3300/0 conn(0x7ff67c1517b0 0x7ff67c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff67bfff640 1 -- 172.21.15.77:0/519207073 >> v2:172.21.15.96:3300/0 conn(0x7ff67c1517b0 msgr2=0x7ff67c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff67bfff640 1 --2- 172.21.15.77:0/519207073 >> v2:172.21.15.96:3300/0 conn(0x7ff67c1517b0 0x7ff67c151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff67bfff640 1 -- 172.21.15.77:0/519207073 >> v1:172.21.15.77:6789/0 conn(0x7ff67c06f370 legacy=0x7ff67c0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff67bfff640 1 -- 172.21.15.77:0/519207073 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c0c3f90 con 0x7ff67c155850 2024-04-25T13:47:09.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:08.998+0000 7ff67b7fe640 1 -- 172.21.15.77:0/519207073 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991702859 0 0) 0x7ff67c152100 con 0x7ff67c06f370 2024-04-25T13:47:09.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff67bfff640 1 --2- 172.21.15.77:0/519207073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c155850 0x7ff67c071520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff67c072c70 tx=0x7ff66401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9444e8669eda04c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:09.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff67b7fe640 1 -- 172.21.15.77:0/519207073 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640b0070 con 0x7ff67c155850 2024-04-25T13:47:09.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff67b7fe640 1 -- 172.21.15.77:0/519207073 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6640ab600 con 0x7ff67c155850 2024-04-25T13:47:09.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff67b7fe640 1 -- 172.21.15.77:0/519207073 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640ab9d0 con 0x7ff67c155850 2024-04-25T13:47:09.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 -- 172.21.15.77:0/519207073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c155850 msgr2=0x7ff67c071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 --2- 172.21.15.77:0/519207073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c155850 0x7ff67c071520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff67c072c70 tx=0x7ff66401c520 comp rx=0 tx=0).stop 2024-04-25T13:47:09.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 -- 172.21.15.77:0/519207073 shutdown_connections 2024-04-25T13:47:09.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 --2- 172.21.15.77:0/519207073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c155850 0x7ff67c071520 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 --2- 172.21.15.77:0/519207073 >> v2:172.21.15.96:3300/0 conn(0x7ff67c1517b0 0x7ff67c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 -- 172.21.15.77:0/519207073 >> 172.21.15.77:0/519207073 conn(0x7ff67c0a7b10 msgr2=0x7ff67c0c5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:09.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 -- 172.21.15.77:0/519207073 shutdown_connections 2024-04-25T13:47:09.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 -- 172.21.15.77:0/519207073 wait complete. 2024-04-25T13:47:09.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 Processor -- start 2024-04-25T13:47:09.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.002+0000 7ff683160640 1 -- start start 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff683160640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff67c06f370 0x7ff67c0a8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff683160640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c1517b0 0x7ff67c146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff683160640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff67c155850 0x7ff67c147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff683160640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c155e70 con 0x7ff67c1517b0 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff683160640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c071c70 con 0x7ff67c155850 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff683160640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c15f5f0 con 0x7ff67c06f370 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff67bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c1517b0 0x7ff67c146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff67bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c1517b0 0x7ff67c146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54972/0 (socket says 172.21.15.77:54972) 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff67bfff640 1 -- 172.21.15.77:0/1985348240 learned_addr learned my addr 172.21.15.77:0/1985348240 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff67bfff640 1 -- 172.21.15.77:0/1985348240 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff67c06f370 msgr2=0x7ff67c0a8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff67bfff640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff67c06f370 0x7ff67c0a8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff67bfff640 1 -- 172.21.15.77:0/1985348240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff67c155850 msgr2=0x7ff67c147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff67bfff640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff67c155850 0x7ff67c147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff67bfff640 1 -- 172.21.15.77:0/1985348240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c150f70 con 0x7ff67c1517b0 2024-04-25T13:47:09.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff67bfff640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c1517b0 0x7ff67c146ee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff6640ae040 tx=0x7ff6640192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:09.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff6797fa640 1 -- 172.21.15.77:0/1985348240 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640bb070 con 0x7ff67c1517b0 2024-04-25T13:47:09.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff6797fa640 1 -- 172.21.15.77:0/1985348240 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6640b4630 con 0x7ff67c1517b0 2024-04-25T13:47:09.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c151250 con 0x7ff67c1517b0 2024-04-25T13:47:09.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff6797fa640 1 -- 172.21.15.77:0/1985348240 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640b0040 con 0x7ff67c1517b0 2024-04-25T13:47:09.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c0a9150 con 0x7ff67c1517b0 2024-04-25T13:47:09.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c06a1a0 con 0x7ff67c1517b0 2024-04-25T13:47:09.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff6797fa640 1 -- 172.21.15.77:0/1985348240 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff6640be070 con 0x7ff67c1517b0 2024-04-25T13:47:09.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff6797fa640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff65c06f430 0x7ff65c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff6797fa640 1 -- 172.21.15.77:0/1985348240 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ff664128290 con 0x7ff67c1517b0 2024-04-25T13:47:09.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.006+0000 7ff680efc640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff65c06f430 0x7ff65c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.010+0000 7ff680efc640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff65c06f430 0x7ff65c071940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff674001ca0 tx=0x7ff674007cf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:09.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.010+0000 7ff6797fa640 1 -- 172.21.15.77:0/1985348240 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff664016110 con 0x7ff67c1517b0 2024-04-25T13:47:09.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.158+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff67c0c46c0 con 0x7ff65c06f430 2024-04-25T13:47:09.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.166+0000 7ff6797fa640 1 -- 172.21.15.77:0/1985348240 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253050 (secure 0 0 0) 0x7ff67c0c46c0 con 0x7ff65c06f430 2024-04-25T13:47:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:09.171 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T13:47:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff65c06f430 msgr2=0x7ff65c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff65c06f430 0x7ff65c071940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff674001ca0 tx=0x7ff674007cf0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c1517b0 msgr2=0x7ff67c146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c1517b0 0x7ff67c146ee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff6640ae040 tx=0x7ff6640192c0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 shutdown_connections 2024-04-25T13:47:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7ff65c06f430 0x7ff65c071940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff67c155850 0x7ff67c147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff67c1517b0 0x7ff67c146ee0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 --2- 172.21.15.77:0/1985348240 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff67c06f370 0x7ff67c0a8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 >> 172.21.15.77:0/1985348240 conn(0x7ff67c0a7b10 msgr2=0x7ff67c0c6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 shutdown_connections 2024-04-25T13:47:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.170+0000 7ff683160640 1 -- 172.21.15.77:0/1985348240 wait complete. 2024-04-25T13:47:09.187 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-25T13:47:08.512120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76265210,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":371,"num_read_kb":1008,"num_write":10993,"num_write_kb":81620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19805,"ondisk_log_size":19805,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":505072,"kb_used_data":112688,"kb_used_omap":12,"kb_used_meta":392307,"kb_avail":754469648,"statfs":{"total":773094113280,"available":772576919552,"internally_reserved":0,"allocated":115392512,"data_stored":153233412,"data_compressed":10406040,"data_compressed_allocated":20234240,"data_compressed_original":59367424,"omap_allocated":12752,"internal_metadata":401722928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":265,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004232"},"pg_stats":[{"pgid":"3.3f","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.711440+0000","last_change":"2024-04-25T13:41:04.470225+0000","last_active":"2024-04-25T13:47:01.711440+0000","last_peered":"2024-04-25T13:47:01.711440+0000","last_clean":"2024-04-25T13:47:01.711440+0000","last_became_active":"2024-04-25T13:41:04.434108+0000","last_became_peered":"2024-04-25T13:41:04.434108+0000","last_unstale":"2024-04-25T13:47:01.711440+0000","last_undegraded":"2024-04-25T13:47:01.711440+0000","last_fullsized":"2024-04-25T13:47:01.711440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.654910+0000","last_change":"2024-04-25T13:41:04.422886+0000","last_active":"2024-04-25T13:47:01.654910+0000","last_peered":"2024-04-25T13:47:01.654910+0000","last_clean":"2024-04-25T13:47:01.654910+0000","last_became_active":"2024-04-25T13:41:04.422546+0000","last_became_peered":"2024-04-25T13:41:04.422546+0000","last_unstale":"2024-04-25T13:47:01.654910+0000","last_undegraded":"2024-04-25T13:47:01.654910+0000","last_fullsized":"2024-04-25T13:47:01.654910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'65","reported_seq":83,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.694297+0000","last_change":"2024-04-25T13:41:04.413021+0000","last_active":"2024-04-25T13:47:01.694297+0000","last_peered":"2024-04-25T13:47:01.694297+0000","last_clean":"2024-04-25T13:47:01.694297+0000","last_became_active":"2024-04-25T13:41:04.412382+0000","last_became_peered":"2024-04-25T13:41:04.412382+0000","last_unstale":"2024-04-25T13:47:01.694297+0000","last_undegraded":"2024-04-25T13:47:01.694297+0000","last_fullsized":"2024-04-25T13:47:01.694297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706143+0000","last_change":"2024-04-25T13:41:04.419756+0000","last_active":"2024-04-25T13:47:01.706143+0000","last_peered":"2024-04-25T13:47:01.706143+0000","last_clean":"2024-04-25T13:47:01.706143+0000","last_became_active":"2024-04-25T13:41:04.418367+0000","last_became_peered":"2024-04-25T13:41:04.418367+0000","last_unstale":"2024-04-25T13:47:01.706143+0000","last_undegraded":"2024-04-25T13:47:01.706143+0000","last_fullsized":"2024-04-25T13:47:01.706143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'85","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706761+0000","last_change":"2024-04-25T13:41:04.428788+0000","last_active":"2024-04-25T13:47:01.706761+0000","last_peered":"2024-04-25T13:47:01.706761+0000","last_clean":"2024-04-25T13:47:01.706761+0000","last_became_active":"2024-04-25T13:41:04.428424+0000","last_became_peered":"2024-04-25T13:41:04.428424+0000","last_unstale":"2024-04-25T13:47:01.706761+0000","last_undegraded":"2024-04-25T13:47:01.706761+0000","last_fullsized":"2024-04-25T13:47:01.706761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695923+0000","last_change":"2024-04-25T13:41:04.432387+0000","last_active":"2024-04-25T13:47:01.695923+0000","last_peered":"2024-04-25T13:47:01.695923+0000","last_clean":"2024-04-25T13:47:01.695923+0000","last_became_active":"2024-04-25T13:41:04.431971+0000","last_became_peered":"2024-04-25T13:41:04.431971+0000","last_unstale":"2024-04-25T13:47:01.695923+0000","last_undegraded":"2024-04-25T13:47:01.695923+0000","last_fullsized":"2024-04-25T13:47:01.695923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'93","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.712245+0000","last_change":"2024-04-25T13:41:04.473786+0000","last_active":"2024-04-25T13:47:01.712245+0000","last_peered":"2024-04-25T13:47:01.712245+0000","last_clean":"2024-04-25T13:47:01.712245+0000","last_became_active":"2024-04-25T13:41:04.471082+0000","last_became_peered":"2024-04-25T13:41:04.471082+0000","last_unstale":"2024-04-25T13:47:01.712245+0000","last_undegraded":"2024-04-25T13:47:01.712245+0000","last_fullsized":"2024-04-25T13:47:01.712245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.693577+0000","last_change":"2024-04-25T13:41:04.410956+0000","last_active":"2024-04-25T13:47:01.693577+0000","last_peered":"2024-04-25T13:47:01.693577+0000","last_clean":"2024-04-25T13:47:01.693577+0000","last_became_active":"2024-04-25T13:41:04.410665+0000","last_became_peered":"2024-04-25T13:41:04.410665+0000","last_unstale":"2024-04-25T13:47:01.693577+0000","last_undegraded":"2024-04-25T13:47:01.693577+0000","last_fullsized":"2024-04-25T13:47:01.693577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'89","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.709375+0000","last_change":"2024-04-25T13:41:04.470410+0000","last_active":"2024-04-25T13:47:01.709375+0000","last_peered":"2024-04-25T13:47:01.709375+0000","last_clean":"2024-04-25T13:47:01.709375+0000","last_became_active":"2024-04-25T13:41:04.434676+0000","last_became_peered":"2024-04-25T13:41:04.434676+0000","last_unstale":"2024-04-25T13:47:01.709375+0000","last_undegraded":"2024-04-25T13:47:01.709375+0000","last_fullsized":"2024-04-25T13:47:01.709375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'73","reported_seq":90,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689356+0000","last_change":"2024-04-25T13:41:04.417498+0000","last_active":"2024-04-25T13:47:01.689356+0000","last_peered":"2024-04-25T13:47:01.689356+0000","last_clean":"2024-04-25T13:47:01.689356+0000","last_became_active":"2024-04-25T13:41:04.417145+0000","last_became_peered":"2024-04-25T13:41:04.417145+0000","last_unstale":"2024-04-25T13:47:01.689356+0000","last_undegraded":"2024-04-25T13:47:01.689356+0000","last_fullsized":"2024-04-25T13:47:01.689356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'79","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.642001+0000","last_change":"2024-04-25T13:41:04.417324+0000","last_active":"2024-04-25T13:47:01.642001+0000","last_peered":"2024-04-25T13:47:01.642001+0000","last_clean":"2024-04-25T13:47:01.642001+0000","last_became_active":"2024-04-25T13:41:04.416982+0000","last_became_peered":"2024-04-25T13:41:04.416982+0000","last_unstale":"2024-04-25T13:47:01.642001+0000","last_undegraded":"2024-04-25T13:47:01.642001+0000","last_fullsized":"2024-04-25T13:47:01.642001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689067+0000","last_change":"2024-04-25T13:41:04.412869+0000","last_active":"2024-04-25T13:47:01.689067+0000","last_peered":"2024-04-25T13:47:01.689067+0000","last_clean":"2024-04-25T13:47:01.689067+0000","last_became_active":"2024-04-25T13:41:04.412544+0000","last_became_peered":"2024-04-25T13:41:04.412544+0000","last_unstale":"2024-04-25T13:47:01.689067+0000","last_undegraded":"2024-04-25T13:47:01.689067+0000","last_fullsized":"2024-04-25T13:47:01.689067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'84","reported_seq":102,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.694600+0000","last_change":"2024-04-25T13:41:04.412143+0000","last_active":"2024-04-25T13:47:01.694600+0000","last_peered":"2024-04-25T13:47:01.694600+0000","last_clean":"2024-04-25T13:47:01.694600+0000","last_became_active":"2024-04-25T13:41:04.411840+0000","last_became_peered":"2024-04-25T13:41:04.411840+0000","last_unstale":"2024-04-25T13:47:01.694600+0000","last_undegraded":"2024-04-25T13:47:01.694600+0000","last_fullsized":"2024-04-25T13:47:01.694600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'74","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.680358+0000","last_change":"2024-04-25T13:41:04.426859+0000","last_active":"2024-04-25T13:47:01.680358+0000","last_peered":"2024-04-25T13:47:01.680358+0000","last_clean":"2024-04-25T13:47:01.680358+0000","last_became_active":"2024-04-25T13:41:04.426437+0000","last_became_peered":"2024-04-25T13:41:04.426437+0000","last_unstale":"2024-04-25T13:47:01.680358+0000","last_undegraded":"2024-04-25T13:47:01.680358+0000","last_fullsized":"2024-04-25T13:47:01.680358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:21.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'78","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.709114+0000","last_change":"2024-04-25T13:41:04.410712+0000","last_active":"2024-04-25T13:47:01.709114+0000","last_peered":"2024-04-25T13:47:01.709114+0000","last_clean":"2024-04-25T13:47:01.709114+0000","last_became_active":"2024-04-25T13:41:04.410362+0000","last_became_peered":"2024-04-25T13:41:04.410362+0000","last_unstale":"2024-04-25T13:47:01.709114+0000","last_undegraded":"2024-04-25T13:47:01.709114+0000","last_fullsized":"2024-04-25T13:47:01.709114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.697238+0000","last_change":"2024-04-25T13:41:04.429493+0000","last_active":"2024-04-25T13:47:01.697238+0000","last_peered":"2024-04-25T13:47:01.697238+0000","last_clean":"2024-04-25T13:47:01.697238+0000","last_became_active":"2024-04-25T13:41:04.429116+0000","last_became_peered":"2024-04-25T13:41:04.429116+0000","last_unstale":"2024-04-25T13:47:01.697238+0000","last_undegraded":"2024-04-25T13:47:01.697238+0000","last_fullsized":"2024-04-25T13:47:01.697238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702423+0000","last_change":"2024-04-25T13:41:04.431688+0000","last_active":"2024-04-25T13:47:01.702423+0000","last_peered":"2024-04-25T13:47:01.702423+0000","last_clean":"2024-04-25T13:47:01.702423+0000","last_became_active":"2024-04-25T13:41:04.431231+0000","last_became_peered":"2024-04-25T13:41:04.431231+0000","last_unstale":"2024-04-25T13:47:01.702423+0000","last_undegraded":"2024-04-25T13:47:01.702423+0000","last_fullsized":"2024-04-25T13:47:01.702423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'76","reported_seq":94,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.632423+0000","last_change":"2024-04-25T13:41:04.407914+0000","last_active":"2024-04-25T13:47:01.632423+0000","last_peered":"2024-04-25T13:47:01.632423+0000","last_clean":"2024-04-25T13:47:01.632423+0000","last_became_active":"2024-04-25T13:41:04.407553+0000","last_became_peered":"2024-04-25T13:41:04.407553+0000","last_unstale":"2024-04-25T13:47:01.632423+0000","last_undegraded":"2024-04-25T13:47:01.632423+0000","last_fullsized":"2024-04-25T13:47:01.632423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706072+0000","last_change":"2024-04-25T13:41:04.430301+0000","last_active":"2024-04-25T13:47:01.706072+0000","last_peered":"2024-04-25T13:47:01.706072+0000","last_clean":"2024-04-25T13:47:01.706072+0000","last_became_active":"2024-04-25T13:41:04.428597+0000","last_became_peered":"2024-04-25T13:41:04.428597+0000","last_unstale":"2024-04-25T13:47:01.706072+0000","last_undegraded":"2024-04-25T13:47:01.706072+0000","last_fullsized":"2024-04-25T13:47:01.706072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'82","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.684496+0000","last_change":"2024-04-25T13:41:04.423772+0000","last_active":"2024-04-25T13:47:01.684496+0000","last_peered":"2024-04-25T13:47:01.684496+0000","last_clean":"2024-04-25T13:47:01.684496+0000","last_became_active":"2024-04-25T13:41:04.423453+0000","last_became_peered":"2024-04-25T13:41:04.423453+0000","last_unstale":"2024-04-25T13:47:01.684496+0000","last_undegraded":"2024-04-25T13:47:01.684496+0000","last_fullsized":"2024-04-25T13:47:01.684496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'83","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700754+0000","last_change":"2024-04-25T13:41:04.430195+0000","last_active":"2024-04-25T13:47:01.700754+0000","last_peered":"2024-04-25T13:47:01.700754+0000","last_clean":"2024-04-25T13:47:01.700754+0000","last_became_active":"2024-04-25T13:41:04.429917+0000","last_became_peered":"2024-04-25T13:41:04.429917+0000","last_unstale":"2024-04-25T13:47:01.700754+0000","last_undegraded":"2024-04-25T13:47:01.700754+0000","last_fullsized":"2024-04-25T13:47:01.700754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692652+0000","last_change":"2024-04-25T13:41:04.431579+0000","last_active":"2024-04-25T13:47:01.692652+0000","last_peered":"2024-04-25T13:47:01.692652+0000","last_clean":"2024-04-25T13:47:01.692652+0000","last_became_active":"2024-04-25T13:41:04.431160+0000","last_became_peered":"2024-04-25T13:41:04.431160+0000","last_unstale":"2024-04-25T13:47:01.692652+0000","last_undegraded":"2024-04-25T13:47:01.692652+0000","last_fullsized":"2024-04-25T13:47:01.692652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'69","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698369+0000","last_change":"2024-04-25T13:41:04.423185+0000","last_active":"2024-04-25T13:47:01.698369+0000","last_peered":"2024-04-25T13:47:01.698369+0000","last_clean":"2024-04-25T13:47:01.698369+0000","last_became_active":"2024-04-25T13:41:04.422815+0000","last_became_peered":"2024-04-25T13:41:04.422815+0000","last_unstale":"2024-04-25T13:47:01.698369+0000","last_undegraded":"2024-04-25T13:47:01.698369+0000","last_fullsized":"2024-04-25T13:47:01.698369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698911+0000","last_change":"2024-04-25T13:41:04.415522+0000","last_active":"2024-04-25T13:47:01.698911+0000","last_peered":"2024-04-25T13:47:01.698911+0000","last_clean":"2024-04-25T13:47:01.698911+0000","last_became_active":"2024-04-25T13:41:04.414898+0000","last_became_peered":"2024-04-25T13:41:04.414898+0000","last_unstale":"2024-04-25T13:47:01.698911+0000","last_undegraded":"2024-04-25T13:47:01.698911+0000","last_fullsized":"2024-04-25T13:47:01.698911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698454+0000","last_change":"2024-04-25T13:41:04.422142+0000","last_active":"2024-04-25T13:47:01.698454+0000","last_peered":"2024-04-25T13:47:01.698454+0000","last_clean":"2024-04-25T13:47:01.698454+0000","last_became_active":"2024-04-25T13:41:04.421279+0000","last_became_peered":"2024-04-25T13:41:04.421279+0000","last_unstale":"2024-04-25T13:47:01.698454+0000","last_undegraded":"2024-04-25T13:47:01.698454+0000","last_fullsized":"2024-04-25T13:47:01.698454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'98","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.690874+0000","last_change":"2024-04-25T13:41:04.431595+0000","last_active":"2024-04-25T13:47:01.690874+0000","last_peered":"2024-04-25T13:47:01.690874+0000","last_clean":"2024-04-25T13:47:01.690874+0000","last_became_active":"2024-04-25T13:41:04.431130+0000","last_became_peered":"2024-04-25T13:41:04.431130+0000","last_unstale":"2024-04-25T13:47:01.690874+0000","last_undegraded":"2024-04-25T13:47:01.690874+0000","last_fullsized":"2024-04-25T13:47:01.690874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.615396+0000","last_change":"2024-04-25T13:41:04.413732+0000","last_active":"2024-04-25T13:47:01.615396+0000","last_peered":"2024-04-25T13:47:01.615396+0000","last_clean":"2024-04-25T13:47:01.615396+0000","last_became_active":"2024-04-25T13:41:04.413001+0000","last_became_peered":"2024-04-25T13:41:04.413001+0000","last_unstale":"2024-04-25T13:47:01.615396+0000","last_undegraded":"2024-04-25T13:47:01.615396+0000","last_fullsized":"2024-04-25T13:47:01.615396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'61","reported_seq":73,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.676704+0000","last_change":"2024-04-25T13:41:51.580003+0000","last_active":"2024-04-25T13:47:01.676704+0000","last_peered":"2024-04-25T13:47:01.676704+0000","last_clean":"2024-04-25T13:47:01.676704+0000","last_became_active":"2024-04-25T13:41:51.578959+0000","last_became_peered":"2024-04-25T13:41:51.578959+0000","last_unstale":"2024-04-25T13:47:01.676704+0000","last_undegraded":"2024-04-25T13:47:01.676704+0000","last_fullsized":"2024-04-25T13:47:01.676704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704628+0000","last_change":"2024-04-25T13:41:04.423204+0000","last_active":"2024-04-25T13:47:01.704628+0000","last_peered":"2024-04-25T13:47:01.704628+0000","last_clean":"2024-04-25T13:47:01.704628+0000","last_became_active":"2024-04-25T13:41:04.422855+0000","last_became_peered":"2024-04-25T13:41:04.422855+0000","last_unstale":"2024-04-25T13:47:01.704628+0000","last_undegraded":"2024-04-25T13:47:01.704628+0000","last_fullsized":"2024-04-25T13:47:01.704628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'82","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707704+0000","last_change":"2024-04-25T13:41:04.416506+0000","last_active":"2024-04-25T13:47:01.707704+0000","last_peered":"2024-04-25T13:47:01.707704+0000","last_clean":"2024-04-25T13:47:01.707704+0000","last_became_active":"2024-04-25T13:41:04.416177+0000","last_became_peered":"2024-04-25T13:41:04.416177+0000","last_unstale":"2024-04-25T13:47:01.707704+0000","last_undegraded":"2024-04-25T13:47:01.707704+0000","last_fullsized":"2024-04-25T13:47:01.707704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'92","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705522+0000","last_change":"2024-04-25T13:41:51.963280+0000","last_active":"2024-04-25T13:47:01.705522+0000","last_peered":"2024-04-25T13:47:01.705522+0000","last_clean":"2024-04-25T13:47:01.705522+0000","last_became_active":"2024-04-25T13:41:51.962421+0000","last_became_peered":"2024-04-25T13:41:51.962421+0000","last_unstale":"2024-04-25T13:47:01.705522+0000","last_undegraded":"2024-04-25T13:47:01.705522+0000","last_fullsized":"2024-04-25T13:47:01.705522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'82","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695679+0000","last_change":"2024-04-25T13:41:04.430078+0000","last_active":"2024-04-25T13:47:01.695679+0000","last_peered":"2024-04-25T13:47:01.695679+0000","last_clean":"2024-04-25T13:47:01.695679+0000","last_became_active":"2024-04-25T13:41:04.429518+0000","last_became_peered":"2024-04-25T13:41:04.429518+0000","last_unstale":"2024-04-25T13:47:01.695679+0000","last_undegraded":"2024-04-25T13:47:01.695679+0000","last_fullsized":"2024-04-25T13:47:01.695679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'99","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.673373+0000","last_change":"2024-04-25T13:41:04.402158+0000","last_active":"2024-04-25T13:47:01.673373+0000","last_peered":"2024-04-25T13:47:01.673373+0000","last_clean":"2024-04-25T13:47:01.673373+0000","last_became_active":"2024-04-25T13:41:04.401821+0000","last_became_peered":"2024-04-25T13:41:04.401821+0000","last_unstale":"2024-04-25T13:47:01.673373+0000","last_undegraded":"2024-04-25T13:47:01.673373+0000","last_fullsized":"2024-04-25T13:47:01.673373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:18.457935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'881","reported_seq":901,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.561591+0000","last_change":"2024-04-25T13:41:03.425690+0000","last_active":"2024-04-25T13:46:38.561591+0000","last_peered":"2024-04-25T13:46:38.561591+0000","last_clean":"2024-04-25T13:46:38.561591+0000","last_became_active":"2024-04-25T13:41:03.425239+0000","last_became_peered":"2024-04-25T13:41:03.425239+0000","last_unstale":"2024-04-25T13:46:38.561591+0000","last_undegraded":"2024-04-25T13:46:38.561591+0000","last_fullsized":"2024-04-25T13:46:38.561591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'78","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692647+0000","last_change":"2024-04-25T13:41:04.411250+0000","last_active":"2024-04-25T13:47:01.692647+0000","last_peered":"2024-04-25T13:47:01.692647+0000","last_clean":"2024-04-25T13:47:01.692647+0000","last_became_active":"2024-04-25T13:41:04.400223+0000","last_became_peered":"2024-04-25T13:41:04.400223+0000","last_unstale":"2024-04-25T13:47:01.692647+0000","last_undegraded":"2024-04-25T13:47:01.692647+0000","last_fullsized":"2024-04-25T13:47:01.692647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'462","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.568394+0000","last_change":"2024-04-25T13:41:03.435467+0000","last_active":"2024-04-25T13:46:38.568394+0000","last_peered":"2024-04-25T13:46:38.568394+0000","last_clean":"2024-04-25T13:46:38.568394+0000","last_became_active":"2024-04-25T13:41:03.426677+0000","last_became_peered":"2024-04-25T13:41:03.426677+0000","last_unstale":"2024-04-25T13:46:38.568394+0000","last_undegraded":"2024-04-25T13:46:38.568394+0000","last_fullsized":"2024-04-25T13:46:38.568394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":4234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'118","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.118271+0000","last_change":"2024-04-25T13:41:03.437180+0000","last_active":"2024-04-25T13:45:30.118271+0000","last_peered":"2024-04-25T13:45:30.118271+0000","last_clean":"2024-04-25T13:45:30.118271+0000","last_became_active":"2024-04-25T13:41:03.436905+0000","last_became_peered":"2024-04-25T13:41:03.436905+0000","last_unstale":"2024-04-25T13:45:30.118271+0000","last_undegraded":"2024-04-25T13:45:30.118271+0000","last_fullsized":"2024-04-25T13:45:30.118271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706538+0000","last_change":"2024-04-25T13:41:04.423777+0000","last_active":"2024-04-25T13:47:01.706538+0000","last_peered":"2024-04-25T13:47:01.706538+0000","last_clean":"2024-04-25T13:47:01.706538+0000","last_became_active":"2024-04-25T13:41:04.423470+0000","last_became_peered":"2024-04-25T13:41:04.423470+0000","last_unstale":"2024-04-25T13:47:01.706538+0000","last_undegraded":"2024-04-25T13:47:01.706538+0000","last_fullsized":"2024-04-25T13:47:01.706538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'1580","reported_seq":1600,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.604698+0000","last_change":"2024-04-25T13:41:03.445205+0000","last_active":"2024-04-25T13:47:01.604698+0000","last_peered":"2024-04-25T13:47:01.604698+0000","last_clean":"2024-04-25T13:47:01.604698+0000","last_became_active":"2024-04-25T13:41:03.444412+0000","last_became_peered":"2024-04-25T13:41:03.444412+0000","last_unstale":"2024-04-25T13:47:01.604698+0000","last_undegraded":"2024-04-25T13:47:01.604698+0000","last_fullsized":"2024-04-25T13:47:01.604698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1580,"log_dups_size":0,"ondisk_log_size":1580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7794585,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1453,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'89","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704618+0000","last_change":"2024-04-25T13:41:04.413827+0000","last_active":"2024-04-25T13:47:01.704618+0000","last_peered":"2024-04-25T13:47:01.704618+0000","last_clean":"2024-04-25T13:47:01.704618+0000","last_became_active":"2024-04-25T13:41:04.413496+0000","last_became_peered":"2024-04-25T13:41:04.413496+0000","last_unstale":"2024-04-25T13:47:01.704618+0000","last_undegraded":"2024-04-25T13:47:01.704618+0000","last_fullsized":"2024-04-25T13:47:01.704618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'122","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.558831+0000","last_change":"2024-04-25T13:41:03.450428+0000","last_active":"2024-04-25T13:46:38.558831+0000","last_peered":"2024-04-25T13:46:38.558831+0000","last_clean":"2024-04-25T13:46:38.558831+0000","last_became_active":"2024-04-25T13:41:03.449629+0000","last_became_peered":"2024-04-25T13:41:03.449629+0000","last_unstale":"2024-04-25T13:46:38.558831+0000","last_undegraded":"2024-04-25T13:46:38.558831+0000","last_fullsized":"2024-04-25T13:46:38.558831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'92","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705851+0000","last_change":"2024-04-25T13:41:51.584948+0000","last_active":"2024-04-25T13:47:01.705851+0000","last_peered":"2024-04-25T13:47:01.705851+0000","last_clean":"2024-04-25T13:47:01.705851+0000","last_became_active":"2024-04-25T13:41:51.584089+0000","last_became_peered":"2024-04-25T13:41:51.584089+0000","last_unstale":"2024-04-25T13:47:01.705851+0000","last_undegraded":"2024-04-25T13:47:01.705851+0000","last_fullsized":"2024-04-25T13:47:01.705851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'135","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.558766+0000","last_change":"2024-04-25T13:41:03.445209+0000","last_active":"2024-04-25T13:46:38.558766+0000","last_peered":"2024-04-25T13:46:38.558766+0000","last_clean":"2024-04-25T13:46:38.558766+0000","last_became_active":"2024-04-25T13:41:03.444460+0000","last_became_peered":"2024-04-25T13:41:03.444460+0000","last_unstale":"2024-04-25T13:46:38.558766+0000","last_undegraded":"2024-04-25T13:46:38.558766+0000","last_fullsized":"2024-04-25T13:46:38.558766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.691986+0000","last_change":"2024-04-25T13:41:04.423661+0000","last_active":"2024-04-25T13:47:01.691986+0000","last_peered":"2024-04-25T13:47:01.691986+0000","last_clean":"2024-04-25T13:47:01.691986+0000","last_became_active":"2024-04-25T13:41:04.421991+0000","last_became_peered":"2024-04-25T13:41:04.421991+0000","last_unstale":"2024-04-25T13:47:01.691986+0000","last_undegraded":"2024-04-25T13:47:01.691986+0000","last_fullsized":"2024-04-25T13:47:01.691986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'242","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.574192+0000","last_change":"2024-04-25T13:41:03.443960+0000","last_active":"2024-04-25T13:46:38.574192+0000","last_peered":"2024-04-25T13:46:38.574192+0000","last_clean":"2024-04-25T13:46:38.574192+0000","last_became_active":"2024-04-25T13:41:03.443721+0000","last_became_peered":"2024-04-25T13:41:03.443721+0000","last_unstale":"2024-04-25T13:46:38.574192+0000","last_undegraded":"2024-04-25T13:46:38.574192+0000","last_fullsized":"2024-04-25T13:46:38.574192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700376+0000","last_change":"2024-04-25T13:41:04.423896+0000","last_active":"2024-04-25T13:47:01.700376+0000","last_peered":"2024-04-25T13:47:01.700376+0000","last_clean":"2024-04-25T13:47:01.700376+0000","last_became_active":"2024-04-25T13:41:04.423569+0000","last_became_peered":"2024-04-25T13:41:04.423569+0000","last_unstale":"2024-04-25T13:47:01.700376+0000","last_undegraded":"2024-04-25T13:47:01.700376+0000","last_fullsized":"2024-04-25T13:47:01.700376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'558","reported_seq":577,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.569179+0000","last_change":"2024-04-25T13:41:03.426055+0000","last_active":"2024-04-25T13:46:38.569179+0000","last_peered":"2024-04-25T13:46:38.569179+0000","last_clean":"2024-04-25T13:46:38.569179+0000","last_became_active":"2024-04-25T13:41:03.424990+0000","last_became_peered":"2024-04-25T13:41:03.424990+0000","last_unstale":"2024-04-25T13:46:38.569179+0000","last_undegraded":"2024-04-25T13:46:38.569179+0000","last_fullsized":"2024-04-25T13:46:38.569179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'65","reported_seq":83,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700984+0000","last_change":"2024-04-25T13:41:04.430564+0000","last_active":"2024-04-25T13:47:01.700984+0000","last_peered":"2024-04-25T13:47:01.700984+0000","last_clean":"2024-04-25T13:47:01.700984+0000","last_became_active":"2024-04-25T13:41:04.427802+0000","last_became_peered":"2024-04-25T13:41:04.427802+0000","last_unstale":"2024-04-25T13:47:01.700984+0000","last_undegraded":"2024-04-25T13:47:01.700984+0000","last_fullsized":"2024-04-25T13:47:01.700984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'1525","reported_seq":1545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.553532+0000","last_change":"2024-04-25T13:41:03.422851+0000","last_active":"2024-04-25T13:46:38.553532+0000","last_peered":"2024-04-25T13:46:38.553532+0000","last_clean":"2024-04-25T13:46:38.553532+0000","last_became_active":"2024-04-25T13:41:03.422529+0000","last_became_peered":"2024-04-25T13:41:03.422529+0000","last_unstale":"2024-04-25T13:46:38.553532+0000","last_undegraded":"2024-04-25T13:46:38.553532+0000","last_fullsized":"2024-04-25T13:46:38.553532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1414,"num_write_kb":8966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689666+0000","last_change":"2024-04-25T13:41:04.429077+0000","last_active":"2024-04-25T13:47:01.689666+0000","last_peered":"2024-04-25T13:47:01.689666+0000","last_clean":"2024-04-25T13:47:01.689666+0000","last_became_active":"2024-04-25T13:41:04.428641+0000","last_became_peered":"2024-04-25T13:41:04.428641+0000","last_unstale":"2024-04-25T13:47:01.689666+0000","last_undegraded":"2024-04-25T13:47:01.689666+0000","last_fullsized":"2024-04-25T13:47:01.689666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'125","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.555214+0000","last_change":"2024-04-25T13:41:03.450649+0000","last_active":"2024-04-25T13:46:39.555214+0000","last_peered":"2024-04-25T13:46:39.555214+0000","last_clean":"2024-04-25T13:46:39.555214+0000","last_became_active":"2024-04-25T13:41:03.449872+0000","last_became_peered":"2024-04-25T13:41:03.449872+0000","last_unstale":"2024-04-25T13:46:39.555214+0000","last_undegraded":"2024-04-25T13:46:39.555214+0000","last_fullsized":"2024-04-25T13:46:39.555214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'85","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.677702+0000","last_change":"2024-04-25T13:41:51.580092+0000","last_active":"2024-04-25T13:47:01.677702+0000","last_peered":"2024-04-25T13:47:01.677702+0000","last_clean":"2024-04-25T13:47:01.677702+0000","last_became_active":"2024-04-25T13:41:51.578950+0000","last_became_peered":"2024-04-25T13:41:51.578950+0000","last_unstale":"2024-04-25T13:47:01.677702+0000","last_undegraded":"2024-04-25T13:47:01.677702+0000","last_fullsized":"2024-04-25T13:47:01.677702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"23'124","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:42.457078+0000","last_change":"2024-04-25T13:41:03.423826+0000","last_active":"2024-04-25T13:45:42.457078+0000","last_peered":"2024-04-25T13:45:42.457078+0000","last_clean":"2024-04-25T13:45:42.457078+0000","last_became_active":"2024-04-25T13:41:03.423037+0000","last_became_peered":"2024-04-25T13:41:03.423037+0000","last_unstale":"2024-04-25T13:45:42.457078+0000","last_undegraded":"2024-04-25T13:45:42.457078+0000","last_fullsized":"2024-04-25T13:45:42.457078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'91","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695393+0000","last_change":"2024-04-25T13:41:04.429831+0000","last_active":"2024-04-25T13:47:01.695393+0000","last_peered":"2024-04-25T13:47:01.695393+0000","last_clean":"2024-04-25T13:47:01.695393+0000","last_became_active":"2024-04-25T13:41:04.429110+0000","last_became_peered":"2024-04-25T13:41:04.429110+0000","last_unstale":"2024-04-25T13:47:01.695393+0000","last_undegraded":"2024-04-25T13:47:01.695393+0000","last_fullsized":"2024-04-25T13:47:01.695393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'134","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:42.452354+0000","last_change":"2024-04-25T13:41:03.409148+0000","last_active":"2024-04-25T13:45:42.452354+0000","last_peered":"2024-04-25T13:45:42.452354+0000","last_clean":"2024-04-25T13:45:42.452354+0000","last_became_active":"2024-04-25T13:41:03.408414+0000","last_became_peered":"2024-04-25T13:41:03.408414+0000","last_unstale":"2024-04-25T13:45:42.452354+0000","last_undegraded":"2024-04-25T13:45:42.452354+0000","last_fullsized":"2024-04-25T13:45:42.452354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'94","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707955+0000","last_change":"2024-04-25T13:41:04.426477+0000","last_active":"2024-04-25T13:47:01.707955+0000","last_peered":"2024-04-25T13:47:01.707955+0000","last_clean":"2024-04-25T13:47:01.707955+0000","last_became_active":"2024-04-25T13:41:04.425891+0000","last_became_peered":"2024-04-25T13:41:04.425891+0000","last_unstale":"2024-04-25T13:47:01.707955+0000","last_undegraded":"2024-04-25T13:47:01.707955+0000","last_fullsized":"2024-04-25T13:47:01.707955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'118","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.571270+0000","last_change":"2024-04-25T13:41:03.421716+0000","last_active":"2024-04-25T13:46:38.571270+0000","last_peered":"2024-04-25T13:46:38.571270+0000","last_clean":"2024-04-25T13:46:38.571270+0000","last_became_active":"2024-04-25T13:41:03.420848+0000","last_became_peered":"2024-04-25T13:41:03.420848+0000","last_unstale":"2024-04-25T13:46:38.571270+0000","last_undegraded":"2024-04-25T13:46:38.571270+0000","last_fullsized":"2024-04-25T13:46:38.571270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.389116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706476+0000","last_change":"2024-04-25T13:41:04.429840+0000","last_active":"2024-04-25T13:47:01.706476+0000","last_peered":"2024-04-25T13:47:01.706476+0000","last_clean":"2024-04-25T13:47:01.706476+0000","last_became_active":"2024-04-25T13:41:04.429404+0000","last_became_peered":"2024-04-25T13:41:04.429404+0000","last_unstale":"2024-04-25T13:47:01.706476+0000","last_undegraded":"2024-04-25T13:47:01.706476+0000","last_fullsized":"2024-04-25T13:47:01.706476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'106","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:32.450719+0000","last_change":"2024-04-25T13:41:03.415723+0000","last_active":"2024-04-25T13:45:32.450719+0000","last_peered":"2024-04-25T13:45:32.450719+0000","last_clean":"2024-04-25T13:45:32.450719+0000","last_became_active":"2024-04-25T13:41:03.414957+0000","last_became_peered":"2024-04-25T13:41:03.414957+0000","last_unstale":"2024-04-25T13:45:32.450719+0000","last_undegraded":"2024-04-25T13:45:32.450719+0000","last_fullsized":"2024-04-25T13:45:32.450719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.708064+0000","last_change":"2024-04-25T13:41:04.434675+0000","last_active":"2024-04-25T13:47:01.708064+0000","last_peered":"2024-04-25T13:47:01.708064+0000","last_clean":"2024-04-25T13:47:01.708064+0000","last_became_active":"2024-04-25T13:41:04.434194+0000","last_became_peered":"2024-04-25T13:41:04.434194+0000","last_unstale":"2024-04-25T13:47:01.708064+0000","last_undegraded":"2024-04-25T13:47:01.708064+0000","last_fullsized":"2024-04-25T13:47:01.708064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'576","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.554602+0000","last_change":"2024-04-25T13:41:03.402131+0000","last_active":"2024-04-25T13:46:38.554602+0000","last_peered":"2024-04-25T13:46:38.554602+0000","last_clean":"2024-04-25T13:46:38.554602+0000","last_became_active":"2024-04-25T13:41:03.401398+0000","last_became_peered":"2024-04-25T13:41:03.401398+0000","last_unstale":"2024-04-25T13:46:38.554602+0000","last_undegraded":"2024-04-25T13:46:38.554602+0000","last_fullsized":"2024-04-25T13:46:38.554602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":4320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'92","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704161+0000","last_change":"2024-04-25T13:41:04.418743+0000","last_active":"2024-04-25T13:47:01.704161+0000","last_peered":"2024-04-25T13:47:01.704161+0000","last_clean":"2024-04-25T13:47:01.704161+0000","last_became_active":"2024-04-25T13:41:04.417963+0000","last_became_peered":"2024-04-25T13:41:04.417963+0000","last_unstale":"2024-04-25T13:47:01.704161+0000","last_undegraded":"2024-04-25T13:47:01.704161+0000","last_fullsized":"2024-04-25T13:47:01.704161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'134","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:32.450666+0000","last_change":"2024-04-25T13:41:03.445729+0000","last_active":"2024-04-25T13:45:32.450666+0000","last_peered":"2024-04-25T13:45:32.450666+0000","last_clean":"2024-04-25T13:45:32.450666+0000","last_became_active":"2024-04-25T13:41:03.445293+0000","last_became_peered":"2024-04-25T13:41:03.445293+0000","last_unstale":"2024-04-25T13:45:32.450666+0000","last_undegraded":"2024-04-25T13:45:32.450666+0000","last_fullsized":"2024-04-25T13:45:32.450666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'92","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707261+0000","last_change":"2024-04-25T13:41:51.966509+0000","last_active":"2024-04-25T13:47:01.707261+0000","last_peered":"2024-04-25T13:47:01.707261+0000","last_clean":"2024-04-25T13:47:01.707261+0000","last_became_active":"2024-04-25T13:41:51.965867+0000","last_became_peered":"2024-04-25T13:41:51.965867+0000","last_unstale":"2024-04-25T13:47:01.707261+0000","last_undegraded":"2024-04-25T13:47:01.707261+0000","last_fullsized":"2024-04-25T13:47:01.707261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:14.462796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:02.451274+0000","last_change":"2024-04-25T13:41:00.175142+0000","last_active":"2024-04-25T13:45:02.451274+0000","last_peered":"2024-04-25T13:45:02.451274+0000","last_clean":"2024-04-25T13:45:02.451274+0000","last_became_active":"2024-04-25T13:41:00.172906+0000","last_became_peered":"2024-04-25T13:41:00.172906+0000","last_unstale":"2024-04-25T13:45:02.451274+0000","last_undegraded":"2024-04-25T13:45:02.451274+0000","last_fullsized":"2024-04-25T13:45:02.451274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_clean_scrub_stamp":"2024-04-25T13:40:59.093070+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:38.020124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'122","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.560972+0000","last_change":"2024-04-25T13:41:03.438420+0000","last_active":"2024-04-25T13:46:39.560972+0000","last_peered":"2024-04-25T13:46:39.560972+0000","last_clean":"2024-04-25T13:46:39.560972+0000","last_became_active":"2024-04-25T13:41:03.437569+0000","last_became_peered":"2024-04-25T13:41:03.437569+0000","last_unstale":"2024-04-25T13:46:39.560972+0000","last_undegraded":"2024-04-25T13:46:39.560972+0000","last_fullsized":"2024-04-25T13:46:39.560972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.703768+0000","last_change":"2024-04-25T13:41:04.417328+0000","last_active":"2024-04-25T13:47:01.703768+0000","last_peered":"2024-04-25T13:47:01.703768+0000","last_clean":"2024-04-25T13:47:01.703768+0000","last_became_active":"2024-04-25T13:41:04.416666+0000","last_became_peered":"2024-04-25T13:41:04.416666+0000","last_unstale":"2024-04-25T13:47:01.703768+0000","last_undegraded":"2024-04-25T13:47:01.703768+0000","last_fullsized":"2024-04-25T13:47:01.703768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'1393","reported_seq":1414,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.567347+0000","last_change":"2024-04-25T13:41:03.431855+0000","last_active":"2024-04-25T13:46:38.567347+0000","last_peered":"2024-04-25T13:46:38.567347+0000","last_clean":"2024-04-25T13:46:38.567347+0000","last_became_active":"2024-04-25T13:41:03.429200+0000","last_became_peered":"2024-04-25T13:41:03.429200+0000","last_unstale":"2024-04-25T13:46:38.567347+0000","last_undegraded":"2024-04-25T13:46:38.567347+0000","last_fullsized":"2024-04-25T13:46:38.567347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1393,"log_dups_size":0,"ondisk_log_size":1393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1260,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.672770+0000","last_change":"2024-04-25T13:41:04.411548+0000","last_active":"2024-04-25T13:47:01.672770+0000","last_peered":"2024-04-25T13:47:01.672770+0000","last_clean":"2024-04-25T13:47:01.672770+0000","last_became_active":"2024-04-25T13:41:04.400093+0000","last_became_peered":"2024-04-25T13:41:04.400093+0000","last_unstale":"2024-04-25T13:47:01.672770+0000","last_undegraded":"2024-04-25T13:47:01.672770+0000","last_fullsized":"2024-04-25T13:47:01.672770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:09.999429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'425","reported_seq":750,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.545454+0000","last_change":"2024-04-25T13:41:03.415949+0000","last_active":"2024-04-25T13:46:39.545454+0000","last_peered":"2024-04-25T13:46:39.545454+0000","last_clean":"2024-04-25T13:46:39.545454+0000","last_became_active":"2024-04-25T13:41:03.414899+0000","last_became_peered":"2024-04-25T13:41:03.414899+0000","last_unstale":"2024-04-25T13:46:39.545454+0000","last_undegraded":"2024-04-25T13:46:39.545454+0000","last_fullsized":"2024-04-25T13:46:39.545454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":769923,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":305,"num_write_kb":953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'94","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698710+0000","last_change":"2024-04-25T13:41:04.403032+0000","last_active":"2024-04-25T13:47:01.698710+0000","last_peered":"2024-04-25T13:47:01.698710+0000","last_clean":"2024-04-25T13:47:01.698710+0000","last_became_active":"2024-04-25T13:41:04.402055+0000","last_became_peered":"2024-04-25T13:41:04.402055+0000","last_unstale":"2024-04-25T13:47:01.698710+0000","last_undegraded":"2024-04-25T13:47:01.698710+0000","last_fullsized":"2024-04-25T13:47:01.698710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1421","reported_seq":1441,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.572981+0000","last_change":"2024-04-25T13:41:03.447547+0000","last_active":"2024-04-25T13:46:38.572981+0000","last_peered":"2024-04-25T13:46:38.572981+0000","last_clean":"2024-04-25T13:46:38.572981+0000","last_became_active":"2024-04-25T13:41:03.444429+0000","last_became_peered":"2024-04-25T13:41:03.444429+0000","last_unstale":"2024-04-25T13:46:38.572981+0000","last_undegraded":"2024-04-25T13:46:38.572981+0000","last_fullsized":"2024-04-25T13:46:38.572981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1421,"log_dups_size":0,"ondisk_log_size":1421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.667955+0000","last_change":"2024-04-25T13:41:04.398647+0000","last_active":"2024-04-25T13:47:01.667955+0000","last_peered":"2024-04-25T13:47:01.667955+0000","last_clean":"2024-04-25T13:47:01.667955+0000","last_became_active":"2024-04-25T13:41:04.398287+0000","last_became_peered":"2024-04-25T13:41:04.398287+0000","last_unstale":"2024-04-25T13:47:01.667955+0000","last_undegraded":"2024-04-25T13:47:01.667955+0000","last_fullsized":"2024-04-25T13:47:01.667955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:06.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'115","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.107845+0000","last_change":"2024-04-25T13:41:03.414535+0000","last_active":"2024-04-25T13:45:30.107845+0000","last_peered":"2024-04-25T13:45:30.107845+0000","last_clean":"2024-04-25T13:45:30.107845+0000","last_became_active":"2024-04-25T13:41:03.414145+0000","last_became_peered":"2024-04-25T13:41:03.414145+0000","last_unstale":"2024-04-25T13:45:30.107845+0000","last_undegraded":"2024-04-25T13:45:30.107845+0000","last_fullsized":"2024-04-25T13:45:30.107845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'92","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.703641+0000","last_change":"2024-04-25T13:41:04.419186+0000","last_active":"2024-04-25T13:47:01.703641+0000","last_peered":"2024-04-25T13:47:01.703641+0000","last_clean":"2024-04-25T13:47:01.703641+0000","last_became_active":"2024-04-25T13:41:04.417831+0000","last_became_peered":"2024-04-25T13:41:04.417831+0000","last_unstale":"2024-04-25T13:47:01.703641+0000","last_undegraded":"2024-04-25T13:47:01.703641+0000","last_fullsized":"2024-04-25T13:47:01.703641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'105","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.560065+0000","last_change":"2024-04-25T13:41:03.424206+0000","last_active":"2024-04-25T13:46:38.560065+0000","last_peered":"2024-04-25T13:46:38.560065+0000","last_clean":"2024-04-25T13:46:38.560065+0000","last_became_active":"2024-04-25T13:41:03.423176+0000","last_became_peered":"2024-04-25T13:41:03.423176+0000","last_unstale":"2024-04-25T13:46:38.560065+0000","last_undegraded":"2024-04-25T13:46:38.560065+0000","last_fullsized":"2024-04-25T13:46:38.560065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:23.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'78","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.697730+0000","last_change":"2024-04-25T13:41:04.402353+0000","last_active":"2024-04-25T13:47:01.697730+0000","last_peered":"2024-04-25T13:47:01.697730+0000","last_clean":"2024-04-25T13:47:01.697730+0000","last_became_active":"2024-04-25T13:41:04.402014+0000","last_became_peered":"2024-04-25T13:41:04.402014+0000","last_unstale":"2024-04-25T13:47:01.697730+0000","last_undegraded":"2024-04-25T13:47:01.697730+0000","last_fullsized":"2024-04-25T13:47:01.697730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'358","reported_seq":378,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:42.615289+0000","last_change":"2024-04-25T13:41:03.439449+0000","last_active":"2024-04-25T13:46:42.615289+0000","last_peered":"2024-04-25T13:46:42.615289+0000","last_clean":"2024-04-25T13:46:42.615289+0000","last_became_active":"2024-04-25T13:41:03.439074+0000","last_became_peered":"2024-04-25T13:41:03.439074+0000","last_unstale":"2024-04-25T13:46:42.615289+0000","last_undegraded":"2024-04-25T13:46:42.615289+0000","last_fullsized":"2024-04-25T13:46:42.615289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.699026+0000","last_change":"2024-04-25T13:41:04.418630+0000","last_active":"2024-04-25T13:47:01.699026+0000","last_peered":"2024-04-25T13:47:01.699026+0000","last_clean":"2024-04-25T13:47:01.699026+0000","last_became_active":"2024-04-25T13:41:04.418330+0000","last_became_peered":"2024-04-25T13:41:04.418330+0000","last_unstale":"2024-04-25T13:47:01.699026+0000","last_undegraded":"2024-04-25T13:47:01.699026+0000","last_fullsized":"2024-04-25T13:47:01.699026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'120","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.106212+0000","last_change":"2024-04-25T13:41:03.435851+0000","last_active":"2024-04-25T13:45:30.106212+0000","last_peered":"2024-04-25T13:45:30.106212+0000","last_clean":"2024-04-25T13:45:30.106212+0000","last_became_active":"2024-04-25T13:41:03.434870+0000","last_became_peered":"2024-04-25T13:41:03.434870+0000","last_unstale":"2024-04-25T13:45:30.106212+0000","last_undegraded":"2024-04-25T13:45:30.106212+0000","last_fullsized":"2024-04-25T13:45:30.106212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705633+0000","last_change":"2024-04-25T13:41:04.426962+0000","last_active":"2024-04-25T13:47:01.705633+0000","last_peered":"2024-04-25T13:47:01.705633+0000","last_clean":"2024-04-25T13:47:01.705633+0000","last_became_active":"2024-04-25T13:41:04.426424+0000","last_became_peered":"2024-04-25T13:41:04.426424+0000","last_unstale":"2024-04-25T13:47:01.705633+0000","last_undegraded":"2024-04-25T13:47:01.705633+0000","last_fullsized":"2024-04-25T13:47:01.705633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'654","reported_seq":674,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.565821+0000","last_change":"2024-04-25T13:41:03.430095+0000","last_active":"2024-04-25T13:46:38.565821+0000","last_peered":"2024-04-25T13:46:38.565821+0000","last_clean":"2024-04-25T13:46:38.565821+0000","last_became_active":"2024-04-25T13:41:03.429094+0000","last_became_peered":"2024-04-25T13:41:03.429094+0000","last_unstale":"2024-04-25T13:46:38.565821+0000","last_undegraded":"2024-04-25T13:46:38.565821+0000","last_fullsized":"2024-04-25T13:46:38.565821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'81","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.679923+0000","last_change":"2024-04-25T13:41:04.413097+0000","last_active":"2024-04-25T13:47:01.679923+0000","last_peered":"2024-04-25T13:47:01.679923+0000","last_clean":"2024-04-25T13:47:01.679923+0000","last_became_active":"2024-04-25T13:41:04.412572+0000","last_became_peered":"2024-04-25T13:41:04.412572+0000","last_unstale":"2024-04-25T13:47:01.679923+0000","last_undegraded":"2024-04-25T13:47:01.679923+0000","last_fullsized":"2024-04-25T13:47:01.679923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:50.740570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'126","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.557989+0000","last_change":"2024-04-25T13:41:03.411890+0000","last_active":"2024-04-25T13:46:38.557989+0000","last_peered":"2024-04-25T13:46:38.557989+0000","last_clean":"2024-04-25T13:46:38.557989+0000","last_became_active":"2024-04-25T13:41:03.411481+0000","last_became_peered":"2024-04-25T13:41:03.411481+0000","last_unstale":"2024-04-25T13:46:38.557989+0000","last_undegraded":"2024-04-25T13:46:38.557989+0000","last_fullsized":"2024-04-25T13:46:38.557989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'90","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702621+0000","last_change":"2024-04-25T13:41:04.408896+0000","last_active":"2024-04-25T13:47:01.702621+0000","last_peered":"2024-04-25T13:47:01.702621+0000","last_clean":"2024-04-25T13:47:01.702621+0000","last_became_active":"2024-04-25T13:41:04.408517+0000","last_became_peered":"2024-04-25T13:41:04.408517+0000","last_unstale":"2024-04-25T13:47:01.702621+0000","last_undegraded":"2024-04-25T13:47:01.702621+0000","last_fullsized":"2024-04-25T13:47:01.702621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'128","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:34.111762+0000","last_change":"2024-04-25T13:41:03.408129+0000","last_active":"2024-04-25T13:45:34.111762+0000","last_peered":"2024-04-25T13:45:34.111762+0000","last_clean":"2024-04-25T13:45:34.111762+0000","last_became_active":"2024-04-25T13:41:03.407713+0000","last_became_peered":"2024-04-25T13:41:03.407713+0000","last_unstale":"2024-04-25T13:45:34.111762+0000","last_undegraded":"2024-04-25T13:45:34.111762+0000","last_fullsized":"2024-04-25T13:45:34.111762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'94","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702570+0000","last_change":"2024-04-25T13:41:04.424601+0000","last_active":"2024-04-25T13:47:01.702570+0000","last_peered":"2024-04-25T13:47:01.702570+0000","last_clean":"2024-04-25T13:47:01.702570+0000","last_became_active":"2024-04-25T13:41:04.424153+0000","last_became_peered":"2024-04-25T13:41:04.424153+0000","last_unstale":"2024-04-25T13:47:01.702570+0000","last_undegraded":"2024-04-25T13:47:01.702570+0000","last_fullsized":"2024-04-25T13:47:01.702570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'576","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.562196+0000","last_change":"2024-04-25T13:41:03.431525+0000","last_active":"2024-04-25T13:46:39.562196+0000","last_peered":"2024-04-25T13:46:39.562196+0000","last_clean":"2024-04-25T13:46:39.562196+0000","last_became_active":"2024-04-25T13:41:03.430716+0000","last_became_peered":"2024-04-25T13:41:03.430716+0000","last_unstale":"2024-04-25T13:46:39.562196+0000","last_undegraded":"2024-04-25T13:46:39.562196+0000","last_fullsized":"2024-04-25T13:46:39.562196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:46.480379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'75","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.675680+0000","last_change":"2024-04-25T13:41:04.424614+0000","last_active":"2024-04-25T13:47:01.675680+0000","last_peered":"2024-04-25T13:47:01.675680+0000","last_clean":"2024-04-25T13:47:01.675680+0000","last_became_active":"2024-04-25T13:41:04.424248+0000","last_became_peered":"2024-04-25T13:41:04.424248+0000","last_unstale":"2024-04-25T13:47:01.675680+0000","last_undegraded":"2024-04-25T13:47:01.675680+0000","last_fullsized":"2024-04-25T13:47:01.675680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.682341+0000","last_change":"2024-04-25T13:41:04.425893+0000","last_active":"2024-04-25T13:47:01.682341+0000","last_peered":"2024-04-25T13:47:01.682341+0000","last_clean":"2024-04-25T13:47:01.682341+0000","last_became_active":"2024-04-25T13:41:04.424475+0000","last_became_peered":"2024-04-25T13:41:04.424475+0000","last_unstale":"2024-04-25T13:47:01.682341+0000","last_undegraded":"2024-04-25T13:47:01.682341+0000","last_fullsized":"2024-04-25T13:47:01.682341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'113","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.560700+0000","last_change":"2024-04-25T13:41:03.447296+0000","last_active":"2024-04-25T13:46:39.560700+0000","last_peered":"2024-04-25T13:46:39.560700+0000","last_clean":"2024-04-25T13:46:39.560700+0000","last_became_active":"2024-04-25T13:41:03.446522+0000","last_became_peered":"2024-04-25T13:41:03.446522+0000","last_unstale":"2024-04-25T13:46:39.560700+0000","last_undegraded":"2024-04-25T13:46:39.560700+0000","last_fullsized":"2024-04-25T13:46:39.560700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'74","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692806+0000","last_change":"2024-04-25T13:41:04.424211+0000","last_active":"2024-04-25T13:47:01.692806+0000","last_peered":"2024-04-25T13:47:01.692806+0000","last_clean":"2024-04-25T13:47:01.692806+0000","last_became_active":"2024-04-25T13:41:04.423899+0000","last_became_peered":"2024-04-25T13:41:04.423899+0000","last_unstale":"2024-04-25T13:47:01.692806+0000","last_undegraded":"2024-04-25T13:47:01.692806+0000","last_fullsized":"2024-04-25T13:47:01.692806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'992","reported_seq":1012,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.571565+0000","last_change":"2024-04-25T13:41:03.441717+0000","last_active":"2024-04-25T13:46:38.571565+0000","last_peered":"2024-04-25T13:46:38.571565+0000","last_clean":"2024-04-25T13:46:38.571565+0000","last_became_active":"2024-04-25T13:41:03.440886+0000","last_became_peered":"2024-04-25T13:41:03.440886+0000","last_unstale":"2024-04-25T13:46:38.571565+0000","last_undegraded":"2024-04-25T13:46:38.571565+0000","last_fullsized":"2024-04-25T13:46:38.571565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":8413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'76","reported_seq":94,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.691789+0000","last_change":"2024-04-25T13:41:04.423577+0000","last_active":"2024-04-25T13:47:01.691789+0000","last_peered":"2024-04-25T13:47:01.691789+0000","last_clean":"2024-04-25T13:47:01.691789+0000","last_became_active":"2024-04-25T13:41:04.422496+0000","last_became_peered":"2024-04-25T13:41:04.422496+0000","last_unstale":"2024-04-25T13:47:01.691789+0000","last_undegraded":"2024-04-25T13:47:01.691789+0000","last_fullsized":"2024-04-25T13:47:01.691789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'430","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.550665+0000","last_change":"2024-04-25T13:41:03.418067+0000","last_active":"2024-04-25T13:46:39.550665+0000","last_peered":"2024-04-25T13:46:39.550665+0000","last_clean":"2024-04-25T13:46:39.550665+0000","last_became_active":"2024-04-25T13:41:03.417592+0000","last_became_peered":"2024-04-25T13:41:03.417592+0000","last_unstale":"2024-04-25T13:46:39.550665+0000","last_undegraded":"2024-04-25T13:46:39.550665+0000","last_fullsized":"2024-04-25T13:46:39.550665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'82","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.693266+0000","last_change":"2024-04-25T13:41:04.410387+0000","last_active":"2024-04-25T13:47:01.693266+0000","last_peered":"2024-04-25T13:47:01.693266+0000","last_clean":"2024-04-25T13:47:01.693266+0000","last_became_active":"2024-04-25T13:41:04.410065+0000","last_became_peered":"2024-04-25T13:41:04.410065+0000","last_unstale":"2024-04-25T13:47:01.693266+0000","last_undegraded":"2024-04-25T13:47:01.693266+0000","last_fullsized":"2024-04-25T13:47:01.693266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'435","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.107587+0000","last_change":"2024-04-25T13:41:03.425103+0000","last_active":"2024-04-25T13:45:30.107587+0000","last_peered":"2024-04-25T13:45:30.107587+0000","last_clean":"2024-04-25T13:45:30.107587+0000","last_became_active":"2024-04-25T13:41:03.424688+0000","last_became_peered":"2024-04-25T13:41:03.424688+0000","last_unstale":"2024-04-25T13:45:30.107587+0000","last_undegraded":"2024-04-25T13:45:30.107587+0000","last_fullsized":"2024-04-25T13:45:30.107587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:51.359222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75674842,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":10892,"num_write_kb":79992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113328128,"data_stored":151349684,"data_compressed":10339548,"data_compressed_allocated":20144128,"data_compressed_original":58220544,"omap_allocated":0,"internal_metadata":0},"log_size":14453,"ondisk_log_size":14453,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95428,"kb_used_data":23996,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276412,"statfs":{"total":96636764160,"available":96539045888,"internally_reserved":0,"allocated":24571904,"data_stored":34233256,"data_compressed":2467561,"data_compressed_allocated":4726784,"data_compressed_original":14548992,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50572,"kb_used_data":11076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321268,"statfs":{"total":96636764160,"available":96584978432,"internally_reserved":0,"allocated":11341824,"data_stored":16865762,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58792,"kb_used_data":13728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94313048,"statfs":{"total":96636764160,"available":96576561152,"internally_reserved":0,"allocated":14057472,"data_stored":16271157,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89060,"kb_used_data":21788,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94282780,"statfs":{"total":96636764160,"available":96545566720,"internally_reserved":0,"allocated":22310912,"data_stored":28854105,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":10256384,"data_stored":13441381,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":857797,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65576,"kb_used_data":16352,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94306264,"statfs":{"total":96636764160,"available":96569614336,"internally_reserved":0,"allocated":16744448,"data_stored":21059554,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":14784,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":15138816,"data_stored":21650400,"data_compressed":1741521,"data_compressed_allocated":3354624,"data_compressed_original":10035200,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":20972158,"data_compressed":1708275,"data_compressed_allocated":3309568,"data_compressed_original":9461760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16502784,"data_stored":20971680,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":769923,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":13353507,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":28766231,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13815808,"data_stored":16183283,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11100160,"data_stored":16777888,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24264704,"data_stored":33555014,"data_compressed":2434315,"data_compressed_allocated":4681728,"data_compressed_original":13975552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:47:09.192 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:47:09.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:47:09.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe66f237640 1 Processor -- start 2024-04-25T13:47:09.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe66f237640 1 -- start start 2024-04-25T13:47:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe66f237640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6680a5da0 0x7fe66806f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe66f237640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6680a8900 con 0x7fe66806fdf0 2024-04-25T13:47:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe66f237640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe668150100 con 0x7fe668152dd0 2024-04-25T13:47:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe66f237640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe668074770 con 0x7fe6680a5da0 2024-04-25T13:47:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe667fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe66806fdf0 0x7fe6681526c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55280/0 (socket says 172.21.15.77:55280) 2024-04-25T13:47:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe667fff640 1 -- 172.21.15.77:0/745243054 learned_addr learned my addr 172.21.15.77:0/745243054 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe66cfd3640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6680a5da0 0x7fe66806f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658427420 0 0) 0x7fe6680a8900 con 0x7fe66806fdf0 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe650003530 con 0x7fe66806fdf0 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 255900880 0 0) 0x7fe650003530 con 0x7fe66806fdf0 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6680a5da0 msgr2=0x7fe66806f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6680a5da0 0x7fe66806f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 >> v1:172.21.15.96:6789/0 conn(0x7fe668152dd0 legacy=0x7fe66814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6680a8ba0 con 0x7fe66806fdf0 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fe6580016a0 con 0x7fe66806fdf0 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 >> v1:172.21.15.77:6789/0 conn(0x7fe66806fdf0 legacy=0x7fe6681526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500039f0 0x7fe650003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe650004810 0x7fe650004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6680a5da0 0x7fe6500052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe668074770 con 0x7fe650004810 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe65000bb90 con 0x7fe6500039f0 2024-04-25T13:47:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe65000bd90 con 0x7fe6680a5da0 2024-04-25T13:47:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe667fff640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe650004810 0x7fe650004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe66cfd3640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500039f0 0x7fe650003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe667fff640 1 -- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6680a5da0 msgr2=0x7fe6500052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe667fff640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6680a5da0 0x7fe6500052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe667fff640 1 -- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500039f0 msgr2=0x7fe650003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe667fff640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500039f0 0x7fe650003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.378+0000 7fe667fff640 1 -- 172.21.15.77:0/745243054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe650003530 con 0x7fe650004810 2024-04-25T13:47:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe667fff640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe650004810 0x7fe650004c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe668074a30 tx=0x7fe65801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dca5eaeeb1f04e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658007da0 con 0x7fe650004810 2024-04-25T13:47:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6580a9070 con 0x7fe650004810 2024-04-25T13:47:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe6677fe640 1 -- 172.21.15.77:0/745243054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658005d00 con 0x7fe650004810 2024-04-25T13:47:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe66f237640 1 -- 172.21.15.77:0/745243054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe650004810 msgr2=0x7fe650004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe66f237640 1 --2- 172.21.15.77:0/745243054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe650004810 0x7fe650004c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe668074a30 tx=0x7fe65801cbc0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe66d7d4640 1 -- 172.21.15.77:0/745243054 reap_dead start 2024-04-25T13:47:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe66f237640 1 -- 172.21.15.77:0/745243054 shutdown_connections 2024-04-25T13:47:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe66f237640 1 -- 172.21.15.77:0/745243054 >> 172.21.15.77:0/745243054 conn(0x7fe6680c02a0 msgr2=0x7fe6680c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe66f237640 1 -- 172.21.15.77:0/745243054 shutdown_connections 2024-04-25T13:47:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.382+0000 7fe66f237640 1 -- 172.21.15.77:0/745243054 wait complete. 2024-04-25T13:47:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 Processor -- start 2024-04-25T13:47:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 -- start start 2024-04-25T13:47:09.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe650004810 0x7fe6681567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668155de0 0x7fe6681ef920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe668149b50 0x7fe668142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe66815b600 con 0x7fe668149b50 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe66815b480 con 0x7fe668155de0 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe66815b780 con 0x7fe650004810 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66d7d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe668149b50 0x7fe668142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66d7d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe668149b50 0x7fe668142ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54978/0 (socket says 172.21.15.77:54978) 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66d7d4640 1 -- 172.21.15.77:0/1426926821 learned_addr learned my addr 172.21.15.77:0/1426926821 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66cfd3640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe650004810 0x7fe6681567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe667fff640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668155de0 0x7fe6681ef920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66d7d4640 1 -- 172.21.15.77:0/1426926821 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe650004810 msgr2=0x7fe6681567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66d7d4640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe650004810 0x7fe6681567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66d7d4640 1 -- 172.21.15.77:0/1426926821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668155de0 msgr2=0x7fe6681ef920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66d7d4640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668155de0 0x7fe6681ef920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66d7d4640 1 -- 172.21.15.77:0/1426926821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe668156300 con 0x7fe668149b50 2024-04-25T13:47:09.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66d7d4640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe668149b50 0x7fe668142ba0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe668153760 tx=0x7fe66000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:09.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe6657fa640 1 -- 172.21.15.77:0/1426926821 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660017070 con 0x7fe668149b50 2024-04-25T13:47:09.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe6657fa640 1 -- 172.21.15.77:0/1426926821 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe660005d70 con 0x7fe668149b50 2024-04-25T13:47:09.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe6657fa640 1 -- 172.21.15.77:0/1426926821 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66000a850 con 0x7fe668149b50 2024-04-25T13:47:09.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6681ef180 con 0x7fe668149b50 2024-04-25T13:47:09.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6681ef420 con 0x7fe668149b50 2024-04-25T13:47:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.386+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66806a280 con 0x7fe668149b50 2024-04-25T13:47:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.390+0000 7fe6657fa640 1 -- 172.21.15.77:0/1426926821 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe66001a070 con 0x7fe668149b50 2024-04-25T13:47:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.390+0000 7fe6657fa640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe65406f400 0x7fe654071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.390+0000 7fe66cfd3640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe65406f400 0x7fe654071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.390+0000 7fe6657fa640 1 -- 172.21.15.77:0/1426926821 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe66008e430 con 0x7fe668149b50 2024-04-25T13:47:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.390+0000 7fe66cfd3640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe65406f400 0x7fe654071910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe668070df0 tx=0x7fe65c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:09.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.394+0000 7fe6657fa640 1 -- 172.21.15.77:0/1426926821 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe66005b290 con 0x7fe668149b50 2024-04-25T13:47:09.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.550+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe66814dbc0 con 0x7fe65406f400 2024-04-25T13:47:09.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.566+0000 7fe6657fa640 1 -- 172.21.15.77:0/1426926821 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253050 (secure 0 0 0) 0x7fe66814dbc0 con 0x7fe65406f400 2024-04-25T13:47:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:09.571 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T13:47:09.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe65406f400 msgr2=0x7fe654071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe65406f400 0x7fe654071910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe668070df0 tx=0x7fe65c008040 comp rx=0 tx=0).stop 2024-04-25T13:47:09.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe668149b50 msgr2=0x7fe668142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe668149b50 0x7fe668142ba0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe668153760 tx=0x7fe66000cb90 comp rx=0 tx=0).stop 2024-04-25T13:47:09.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 shutdown_connections 2024-04-25T13:47:09.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe65406f400 0x7fe654071910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe668149b50 0x7fe668142ba0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668155de0 0x7fe6681ef920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 --2- 172.21.15.77:0/1426926821 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe650004810 0x7fe6681567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 >> 172.21.15.77:0/1426926821 conn(0x7fe6680c02a0 msgr2=0x7fe6680c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:09.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 shutdown_connections 2024-04-25T13:47:09.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.570+0000 7fe66f237640 1 -- 172.21.15.77:0/1426926821 wait complete. 2024-04-25T13:47:09.591 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-25T13:47:08.512120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76265210,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":371,"num_read_kb":1008,"num_write":10993,"num_write_kb":81620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19805,"ondisk_log_size":19805,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":505072,"kb_used_data":112688,"kb_used_omap":12,"kb_used_meta":392307,"kb_avail":754469648,"statfs":{"total":773094113280,"available":772576919552,"internally_reserved":0,"allocated":115392512,"data_stored":153233412,"data_compressed":10406040,"data_compressed_allocated":20234240,"data_compressed_original":59367424,"omap_allocated":12752,"internal_metadata":401722928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":265,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004232"},"pg_stats":[{"pgid":"3.3f","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.711440+0000","last_change":"2024-04-25T13:41:04.470225+0000","last_active":"2024-04-25T13:47:01.711440+0000","last_peered":"2024-04-25T13:47:01.711440+0000","last_clean":"2024-04-25T13:47:01.711440+0000","last_became_active":"2024-04-25T13:41:04.434108+0000","last_became_peered":"2024-04-25T13:41:04.434108+0000","last_unstale":"2024-04-25T13:47:01.711440+0000","last_undegraded":"2024-04-25T13:47:01.711440+0000","last_fullsized":"2024-04-25T13:47:01.711440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.654910+0000","last_change":"2024-04-25T13:41:04.422886+0000","last_active":"2024-04-25T13:47:01.654910+0000","last_peered":"2024-04-25T13:47:01.654910+0000","last_clean":"2024-04-25T13:47:01.654910+0000","last_became_active":"2024-04-25T13:41:04.422546+0000","last_became_peered":"2024-04-25T13:41:04.422546+0000","last_unstale":"2024-04-25T13:47:01.654910+0000","last_undegraded":"2024-04-25T13:47:01.654910+0000","last_fullsized":"2024-04-25T13:47:01.654910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'65","reported_seq":83,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.694297+0000","last_change":"2024-04-25T13:41:04.413021+0000","last_active":"2024-04-25T13:47:01.694297+0000","last_peered":"2024-04-25T13:47:01.694297+0000","last_clean":"2024-04-25T13:47:01.694297+0000","last_became_active":"2024-04-25T13:41:04.412382+0000","last_became_peered":"2024-04-25T13:41:04.412382+0000","last_unstale":"2024-04-25T13:47:01.694297+0000","last_undegraded":"2024-04-25T13:47:01.694297+0000","last_fullsized":"2024-04-25T13:47:01.694297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706143+0000","last_change":"2024-04-25T13:41:04.419756+0000","last_active":"2024-04-25T13:47:01.706143+0000","last_peered":"2024-04-25T13:47:01.706143+0000","last_clean":"2024-04-25T13:47:01.706143+0000","last_became_active":"2024-04-25T13:41:04.418367+0000","last_became_peered":"2024-04-25T13:41:04.418367+0000","last_unstale":"2024-04-25T13:47:01.706143+0000","last_undegraded":"2024-04-25T13:47:01.706143+0000","last_fullsized":"2024-04-25T13:47:01.706143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'85","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706761+0000","last_change":"2024-04-25T13:41:04.428788+0000","last_active":"2024-04-25T13:47:01.706761+0000","last_peered":"2024-04-25T13:47:01.706761+0000","last_clean":"2024-04-25T13:47:01.706761+0000","last_became_active":"2024-04-25T13:41:04.428424+0000","last_became_peered":"2024-04-25T13:41:04.428424+0000","last_unstale":"2024-04-25T13:47:01.706761+0000","last_undegraded":"2024-04-25T13:47:01.706761+0000","last_fullsized":"2024-04-25T13:47:01.706761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695923+0000","last_change":"2024-04-25T13:41:04.432387+0000","last_active":"2024-04-25T13:47:01.695923+0000","last_peered":"2024-04-25T13:47:01.695923+0000","last_clean":"2024-04-25T13:47:01.695923+0000","last_became_active":"2024-04-25T13:41:04.431971+0000","last_became_peered":"2024-04-25T13:41:04.431971+0000","last_unstale":"2024-04-25T13:47:01.695923+0000","last_undegraded":"2024-04-25T13:47:01.695923+0000","last_fullsized":"2024-04-25T13:47:01.695923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'93","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.712245+0000","last_change":"2024-04-25T13:41:04.473786+0000","last_active":"2024-04-25T13:47:01.712245+0000","last_peered":"2024-04-25T13:47:01.712245+0000","last_clean":"2024-04-25T13:47:01.712245+0000","last_became_active":"2024-04-25T13:41:04.471082+0000","last_became_peered":"2024-04-25T13:41:04.471082+0000","last_unstale":"2024-04-25T13:47:01.712245+0000","last_undegraded":"2024-04-25T13:47:01.712245+0000","last_fullsized":"2024-04-25T13:47:01.712245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.693577+0000","last_change":"2024-04-25T13:41:04.410956+0000","last_active":"2024-04-25T13:47:01.693577+0000","last_peered":"2024-04-25T13:47:01.693577+0000","last_clean":"2024-04-25T13:47:01.693577+0000","last_became_active":"2024-04-25T13:41:04.410665+0000","last_became_peered":"2024-04-25T13:41:04.410665+0000","last_unstale":"2024-04-25T13:47:01.693577+0000","last_undegraded":"2024-04-25T13:47:01.693577+0000","last_fullsized":"2024-04-25T13:47:01.693577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'89","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.709375+0000","last_change":"2024-04-25T13:41:04.470410+0000","last_active":"2024-04-25T13:47:01.709375+0000","last_peered":"2024-04-25T13:47:01.709375+0000","last_clean":"2024-04-25T13:47:01.709375+0000","last_became_active":"2024-04-25T13:41:04.434676+0000","last_became_peered":"2024-04-25T13:41:04.434676+0000","last_unstale":"2024-04-25T13:47:01.709375+0000","last_undegraded":"2024-04-25T13:47:01.709375+0000","last_fullsized":"2024-04-25T13:47:01.709375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'73","reported_seq":90,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689356+0000","last_change":"2024-04-25T13:41:04.417498+0000","last_active":"2024-04-25T13:47:01.689356+0000","last_peered":"2024-04-25T13:47:01.689356+0000","last_clean":"2024-04-25T13:47:01.689356+0000","last_became_active":"2024-04-25T13:41:04.417145+0000","last_became_peered":"2024-04-25T13:41:04.417145+0000","last_unstale":"2024-04-25T13:47:01.689356+0000","last_undegraded":"2024-04-25T13:47:01.689356+0000","last_fullsized":"2024-04-25T13:47:01.689356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'79","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.642001+0000","last_change":"2024-04-25T13:41:04.417324+0000","last_active":"2024-04-25T13:47:01.642001+0000","last_peered":"2024-04-25T13:47:01.642001+0000","last_clean":"2024-04-25T13:47:01.642001+0000","last_became_active":"2024-04-25T13:41:04.416982+0000","last_became_peered":"2024-04-25T13:41:04.416982+0000","last_unstale":"2024-04-25T13:47:01.642001+0000","last_undegraded":"2024-04-25T13:47:01.642001+0000","last_fullsized":"2024-04-25T13:47:01.642001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689067+0000","last_change":"2024-04-25T13:41:04.412869+0000","last_active":"2024-04-25T13:47:01.689067+0000","last_peered":"2024-04-25T13:47:01.689067+0000","last_clean":"2024-04-25T13:47:01.689067+0000","last_became_active":"2024-04-25T13:41:04.412544+0000","last_became_peered":"2024-04-25T13:41:04.412544+0000","last_unstale":"2024-04-25T13:47:01.689067+0000","last_undegraded":"2024-04-25T13:47:01.689067+0000","last_fullsized":"2024-04-25T13:47:01.689067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'84","reported_seq":102,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.694600+0000","last_change":"2024-04-25T13:41:04.412143+0000","last_active":"2024-04-25T13:47:01.694600+0000","last_peered":"2024-04-25T13:47:01.694600+0000","last_clean":"2024-04-25T13:47:01.694600+0000","last_became_active":"2024-04-25T13:41:04.411840+0000","last_became_peered":"2024-04-25T13:41:04.411840+0000","last_unstale":"2024-04-25T13:47:01.694600+0000","last_undegraded":"2024-04-25T13:47:01.694600+0000","last_fullsized":"2024-04-25T13:47:01.694600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'74","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.680358+0000","last_change":"2024-04-25T13:41:04.426859+0000","last_active":"2024-04-25T13:47:01.680358+0000","last_peered":"2024-04-25T13:47:01.680358+0000","last_clean":"2024-04-25T13:47:01.680358+0000","last_became_active":"2024-04-25T13:41:04.426437+0000","last_became_peered":"2024-04-25T13:41:04.426437+0000","last_unstale":"2024-04-25T13:47:01.680358+0000","last_undegraded":"2024-04-25T13:47:01.680358+0000","last_fullsized":"2024-04-25T13:47:01.680358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:21.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'78","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.709114+0000","last_change":"2024-04-25T13:41:04.410712+0000","last_active":"2024-04-25T13:47:01.709114+0000","last_peered":"2024-04-25T13:47:01.709114+0000","last_clean":"2024-04-25T13:47:01.709114+0000","last_became_active":"2024-04-25T13:41:04.410362+0000","last_became_peered":"2024-04-25T13:41:04.410362+0000","last_unstale":"2024-04-25T13:47:01.709114+0000","last_undegraded":"2024-04-25T13:47:01.709114+0000","last_fullsized":"2024-04-25T13:47:01.709114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.697238+0000","last_change":"2024-04-25T13:41:04.429493+0000","last_active":"2024-04-25T13:47:01.697238+0000","last_peered":"2024-04-25T13:47:01.697238+0000","last_clean":"2024-04-25T13:47:01.697238+0000","last_became_active":"2024-04-25T13:41:04.429116+0000","last_became_peered":"2024-04-25T13:41:04.429116+0000","last_unstale":"2024-04-25T13:47:01.697238+0000","last_undegraded":"2024-04-25T13:47:01.697238+0000","last_fullsized":"2024-04-25T13:47:01.697238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702423+0000","last_change":"2024-04-25T13:41:04.431688+0000","last_active":"2024-04-25T13:47:01.702423+0000","last_peered":"2024-04-25T13:47:01.702423+0000","last_clean":"2024-04-25T13:47:01.702423+0000","last_became_active":"2024-04-25T13:41:04.431231+0000","last_became_peered":"2024-04-25T13:41:04.431231+0000","last_unstale":"2024-04-25T13:47:01.702423+0000","last_undegraded":"2024-04-25T13:47:01.702423+0000","last_fullsized":"2024-04-25T13:47:01.702423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'76","reported_seq":94,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.632423+0000","last_change":"2024-04-25T13:41:04.407914+0000","last_active":"2024-04-25T13:47:01.632423+0000","last_peered":"2024-04-25T13:47:01.632423+0000","last_clean":"2024-04-25T13:47:01.632423+0000","last_became_active":"2024-04-25T13:41:04.407553+0000","last_became_peered":"2024-04-25T13:41:04.407553+0000","last_unstale":"2024-04-25T13:47:01.632423+0000","last_undegraded":"2024-04-25T13:47:01.632423+0000","last_fullsized":"2024-04-25T13:47:01.632423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706072+0000","last_change":"2024-04-25T13:41:04.430301+0000","last_active":"2024-04-25T13:47:01.706072+0000","last_peered":"2024-04-25T13:47:01.706072+0000","last_clean":"2024-04-25T13:47:01.706072+0000","last_became_active":"2024-04-25T13:41:04.428597+0000","last_became_peered":"2024-04-25T13:41:04.428597+0000","last_unstale":"2024-04-25T13:47:01.706072+0000","last_undegraded":"2024-04-25T13:47:01.706072+0000","last_fullsized":"2024-04-25T13:47:01.706072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'82","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.684496+0000","last_change":"2024-04-25T13:41:04.423772+0000","last_active":"2024-04-25T13:47:01.684496+0000","last_peered":"2024-04-25T13:47:01.684496+0000","last_clean":"2024-04-25T13:47:01.684496+0000","last_became_active":"2024-04-25T13:41:04.423453+0000","last_became_peered":"2024-04-25T13:41:04.423453+0000","last_unstale":"2024-04-25T13:47:01.684496+0000","last_undegraded":"2024-04-25T13:47:01.684496+0000","last_fullsized":"2024-04-25T13:47:01.684496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'83","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700754+0000","last_change":"2024-04-25T13:41:04.430195+0000","last_active":"2024-04-25T13:47:01.700754+0000","last_peered":"2024-04-25T13:47:01.700754+0000","last_clean":"2024-04-25T13:47:01.700754+0000","last_became_active":"2024-04-25T13:41:04.429917+0000","last_became_peered":"2024-04-25T13:41:04.429917+0000","last_unstale":"2024-04-25T13:47:01.700754+0000","last_undegraded":"2024-04-25T13:47:01.700754+0000","last_fullsized":"2024-04-25T13:47:01.700754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692652+0000","last_change":"2024-04-25T13:41:04.431579+0000","last_active":"2024-04-25T13:47:01.692652+0000","last_peered":"2024-04-25T13:47:01.692652+0000","last_clean":"2024-04-25T13:47:01.692652+0000","last_became_active":"2024-04-25T13:41:04.431160+0000","last_became_peered":"2024-04-25T13:41:04.431160+0000","last_unstale":"2024-04-25T13:47:01.692652+0000","last_undegraded":"2024-04-25T13:47:01.692652+0000","last_fullsized":"2024-04-25T13:47:01.692652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'69","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698369+0000","last_change":"2024-04-25T13:41:04.423185+0000","last_active":"2024-04-25T13:47:01.698369+0000","last_peered":"2024-04-25T13:47:01.698369+0000","last_clean":"2024-04-25T13:47:01.698369+0000","last_became_active":"2024-04-25T13:41:04.422815+0000","last_became_peered":"2024-04-25T13:41:04.422815+0000","last_unstale":"2024-04-25T13:47:01.698369+0000","last_undegraded":"2024-04-25T13:47:01.698369+0000","last_fullsized":"2024-04-25T13:47:01.698369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698911+0000","last_change":"2024-04-25T13:41:04.415522+0000","last_active":"2024-04-25T13:47:01.698911+0000","last_peered":"2024-04-25T13:47:01.698911+0000","last_clean":"2024-04-25T13:47:01.698911+0000","last_became_active":"2024-04-25T13:41:04.414898+0000","last_became_peered":"2024-04-25T13:41:04.414898+0000","last_unstale":"2024-04-25T13:47:01.698911+0000","last_undegraded":"2024-04-25T13:47:01.698911+0000","last_fullsized":"2024-04-25T13:47:01.698911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698454+0000","last_change":"2024-04-25T13:41:04.422142+0000","last_active":"2024-04-25T13:47:01.698454+0000","last_peered":"2024-04-25T13:47:01.698454+0000","last_clean":"2024-04-25T13:47:01.698454+0000","last_became_active":"2024-04-25T13:41:04.421279+0000","last_became_peered":"2024-04-25T13:41:04.421279+0000","last_unstale":"2024-04-25T13:47:01.698454+0000","last_undegraded":"2024-04-25T13:47:01.698454+0000","last_fullsized":"2024-04-25T13:47:01.698454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'98","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.690874+0000","last_change":"2024-04-25T13:41:04.431595+0000","last_active":"2024-04-25T13:47:01.690874+0000","last_peered":"2024-04-25T13:47:01.690874+0000","last_clean":"2024-04-25T13:47:01.690874+0000","last_became_active":"2024-04-25T13:41:04.431130+0000","last_became_peered":"2024-04-25T13:41:04.431130+0000","last_unstale":"2024-04-25T13:47:01.690874+0000","last_undegraded":"2024-04-25T13:47:01.690874+0000","last_fullsized":"2024-04-25T13:47:01.690874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.615396+0000","last_change":"2024-04-25T13:41:04.413732+0000","last_active":"2024-04-25T13:47:01.615396+0000","last_peered":"2024-04-25T13:47:01.615396+0000","last_clean":"2024-04-25T13:47:01.615396+0000","last_became_active":"2024-04-25T13:41:04.413001+0000","last_became_peered":"2024-04-25T13:41:04.413001+0000","last_unstale":"2024-04-25T13:47:01.615396+0000","last_undegraded":"2024-04-25T13:47:01.615396+0000","last_fullsized":"2024-04-25T13:47:01.615396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'61","reported_seq":73,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.676704+0000","last_change":"2024-04-25T13:41:51.580003+0000","last_active":"2024-04-25T13:47:01.676704+0000","last_peered":"2024-04-25T13:47:01.676704+0000","last_clean":"2024-04-25T13:47:01.676704+0000","last_became_active":"2024-04-25T13:41:51.578959+0000","last_became_peered":"2024-04-25T13:41:51.578959+0000","last_unstale":"2024-04-25T13:47:01.676704+0000","last_undegraded":"2024-04-25T13:47:01.676704+0000","last_fullsized":"2024-04-25T13:47:01.676704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704628+0000","last_change":"2024-04-25T13:41:04.423204+0000","last_active":"2024-04-25T13:47:01.704628+0000","last_peered":"2024-04-25T13:47:01.704628+0000","last_clean":"2024-04-25T13:47:01.704628+0000","last_became_active":"2024-04-25T13:41:04.422855+0000","last_became_peered":"2024-04-25T13:41:04.422855+0000","last_unstale":"2024-04-25T13:47:01.704628+0000","last_undegraded":"2024-04-25T13:47:01.704628+0000","last_fullsized":"2024-04-25T13:47:01.704628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'82","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707704+0000","last_change":"2024-04-25T13:41:04.416506+0000","last_active":"2024-04-25T13:47:01.707704+0000","last_peered":"2024-04-25T13:47:01.707704+0000","last_clean":"2024-04-25T13:47:01.707704+0000","last_became_active":"2024-04-25T13:41:04.416177+0000","last_became_peered":"2024-04-25T13:41:04.416177+0000","last_unstale":"2024-04-25T13:47:01.707704+0000","last_undegraded":"2024-04-25T13:47:01.707704+0000","last_fullsized":"2024-04-25T13:47:01.707704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'92","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705522+0000","last_change":"2024-04-25T13:41:51.963280+0000","last_active":"2024-04-25T13:47:01.705522+0000","last_peered":"2024-04-25T13:47:01.705522+0000","last_clean":"2024-04-25T13:47:01.705522+0000","last_became_active":"2024-04-25T13:41:51.962421+0000","last_became_peered":"2024-04-25T13:41:51.962421+0000","last_unstale":"2024-04-25T13:47:01.705522+0000","last_undegraded":"2024-04-25T13:47:01.705522+0000","last_fullsized":"2024-04-25T13:47:01.705522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'82","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695679+0000","last_change":"2024-04-25T13:41:04.430078+0000","last_active":"2024-04-25T13:47:01.695679+0000","last_peered":"2024-04-25T13:47:01.695679+0000","last_clean":"2024-04-25T13:47:01.695679+0000","last_became_active":"2024-04-25T13:41:04.429518+0000","last_became_peered":"2024-04-25T13:41:04.429518+0000","last_unstale":"2024-04-25T13:47:01.695679+0000","last_undegraded":"2024-04-25T13:47:01.695679+0000","last_fullsized":"2024-04-25T13:47:01.695679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'99","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.673373+0000","last_change":"2024-04-25T13:41:04.402158+0000","last_active":"2024-04-25T13:47:01.673373+0000","last_peered":"2024-04-25T13:47:01.673373+0000","last_clean":"2024-04-25T13:47:01.673373+0000","last_became_active":"2024-04-25T13:41:04.401821+0000","last_became_peered":"2024-04-25T13:41:04.401821+0000","last_unstale":"2024-04-25T13:47:01.673373+0000","last_undegraded":"2024-04-25T13:47:01.673373+0000","last_fullsized":"2024-04-25T13:47:01.673373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:18.457935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'881","reported_seq":901,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.561591+0000","last_change":"2024-04-25T13:41:03.425690+0000","last_active":"2024-04-25T13:46:38.561591+0000","last_peered":"2024-04-25T13:46:38.561591+0000","last_clean":"2024-04-25T13:46:38.561591+0000","last_became_active":"2024-04-25T13:41:03.425239+0000","last_became_peered":"2024-04-25T13:41:03.425239+0000","last_unstale":"2024-04-25T13:46:38.561591+0000","last_undegraded":"2024-04-25T13:46:38.561591+0000","last_fullsized":"2024-04-25T13:46:38.561591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'78","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692647+0000","last_change":"2024-04-25T13:41:04.411250+0000","last_active":"2024-04-25T13:47:01.692647+0000","last_peered":"2024-04-25T13:47:01.692647+0000","last_clean":"2024-04-25T13:47:01.692647+0000","last_became_active":"2024-04-25T13:41:04.400223+0000","last_became_peered":"2024-04-25T13:41:04.400223+0000","last_unstale":"2024-04-25T13:47:01.692647+0000","last_undegraded":"2024-04-25T13:47:01.692647+0000","last_fullsized":"2024-04-25T13:47:01.692647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'462","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.568394+0000","last_change":"2024-04-25T13:41:03.435467+0000","last_active":"2024-04-25T13:46:38.568394+0000","last_peered":"2024-04-25T13:46:38.568394+0000","last_clean":"2024-04-25T13:46:38.568394+0000","last_became_active":"2024-04-25T13:41:03.426677+0000","last_became_peered":"2024-04-25T13:41:03.426677+0000","last_unstale":"2024-04-25T13:46:38.568394+0000","last_undegraded":"2024-04-25T13:46:38.568394+0000","last_fullsized":"2024-04-25T13:46:38.568394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":4234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'118","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.118271+0000","last_change":"2024-04-25T13:41:03.437180+0000","last_active":"2024-04-25T13:45:30.118271+0000","last_peered":"2024-04-25T13:45:30.118271+0000","last_clean":"2024-04-25T13:45:30.118271+0000","last_became_active":"2024-04-25T13:41:03.436905+0000","last_became_peered":"2024-04-25T13:41:03.436905+0000","last_unstale":"2024-04-25T13:45:30.118271+0000","last_undegraded":"2024-04-25T13:45:30.118271+0000","last_fullsized":"2024-04-25T13:45:30.118271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706538+0000","last_change":"2024-04-25T13:41:04.423777+0000","last_active":"2024-04-25T13:47:01.706538+0000","last_peered":"2024-04-25T13:47:01.706538+0000","last_clean":"2024-04-25T13:47:01.706538+0000","last_became_active":"2024-04-25T13:41:04.423470+0000","last_became_peered":"2024-04-25T13:41:04.423470+0000","last_unstale":"2024-04-25T13:47:01.706538+0000","last_undegraded":"2024-04-25T13:47:01.706538+0000","last_fullsized":"2024-04-25T13:47:01.706538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'1580","reported_seq":1600,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.604698+0000","last_change":"2024-04-25T13:41:03.445205+0000","last_active":"2024-04-25T13:47:01.604698+0000","last_peered":"2024-04-25T13:47:01.604698+0000","last_clean":"2024-04-25T13:47:01.604698+0000","last_became_active":"2024-04-25T13:41:03.444412+0000","last_became_peered":"2024-04-25T13:41:03.444412+0000","last_unstale":"2024-04-25T13:47:01.604698+0000","last_undegraded":"2024-04-25T13:47:01.604698+0000","last_fullsized":"2024-04-25T13:47:01.604698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1580,"log_dups_size":0,"ondisk_log_size":1580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7794585,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1453,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'89","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704618+0000","last_change":"2024-04-25T13:41:04.413827+0000","last_active":"2024-04-25T13:47:01.704618+0000","last_peered":"2024-04-25T13:47:01.704618+0000","last_clean":"2024-04-25T13:47:01.704618+0000","last_became_active":"2024-04-25T13:41:04.413496+0000","last_became_peered":"2024-04-25T13:41:04.413496+0000","last_unstale":"2024-04-25T13:47:01.704618+0000","last_undegraded":"2024-04-25T13:47:01.704618+0000","last_fullsized":"2024-04-25T13:47:01.704618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'122","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.558831+0000","last_change":"2024-04-25T13:41:03.450428+0000","last_active":"2024-04-25T13:46:38.558831+0000","last_peered":"2024-04-25T13:46:38.558831+0000","last_clean":"2024-04-25T13:46:38.558831+0000","last_became_active":"2024-04-25T13:41:03.449629+0000","last_became_peered":"2024-04-25T13:41:03.449629+0000","last_unstale":"2024-04-25T13:46:38.558831+0000","last_undegraded":"2024-04-25T13:46:38.558831+0000","last_fullsized":"2024-04-25T13:46:38.558831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'92","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705851+0000","last_change":"2024-04-25T13:41:51.584948+0000","last_active":"2024-04-25T13:47:01.705851+0000","last_peered":"2024-04-25T13:47:01.705851+0000","last_clean":"2024-04-25T13:47:01.705851+0000","last_became_active":"2024-04-25T13:41:51.584089+0000","last_became_peered":"2024-04-25T13:41:51.584089+0000","last_unstale":"2024-04-25T13:47:01.705851+0000","last_undegraded":"2024-04-25T13:47:01.705851+0000","last_fullsized":"2024-04-25T13:47:01.705851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'135","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.558766+0000","last_change":"2024-04-25T13:41:03.445209+0000","last_active":"2024-04-25T13:46:38.558766+0000","last_peered":"2024-04-25T13:46:38.558766+0000","last_clean":"2024-04-25T13:46:38.558766+0000","last_became_active":"2024-04-25T13:41:03.444460+0000","last_became_peered":"2024-04-25T13:41:03.444460+0000","last_unstale":"2024-04-25T13:46:38.558766+0000","last_undegraded":"2024-04-25T13:46:38.558766+0000","last_fullsized":"2024-04-25T13:46:38.558766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.691986+0000","last_change":"2024-04-25T13:41:04.423661+0000","last_active":"2024-04-25T13:47:01.691986+0000","last_peered":"2024-04-25T13:47:01.691986+0000","last_clean":"2024-04-25T13:47:01.691986+0000","last_became_active":"2024-04-25T13:41:04.421991+0000","last_became_peered":"2024-04-25T13:41:04.421991+0000","last_unstale":"2024-04-25T13:47:01.691986+0000","last_undegraded":"2024-04-25T13:47:01.691986+0000","last_fullsized":"2024-04-25T13:47:01.691986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'242","reported_seq":262,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.574192+0000","last_change":"2024-04-25T13:41:03.443960+0000","last_active":"2024-04-25T13:46:38.574192+0000","last_peered":"2024-04-25T13:46:38.574192+0000","last_clean":"2024-04-25T13:46:38.574192+0000","last_became_active":"2024-04-25T13:41:03.443721+0000","last_became_peered":"2024-04-25T13:41:03.443721+0000","last_unstale":"2024-04-25T13:46:38.574192+0000","last_undegraded":"2024-04-25T13:46:38.574192+0000","last_fullsized":"2024-04-25T13:46:38.574192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700376+0000","last_change":"2024-04-25T13:41:04.423896+0000","last_active":"2024-04-25T13:47:01.700376+0000","last_peered":"2024-04-25T13:47:01.700376+0000","last_clean":"2024-04-25T13:47:01.700376+0000","last_became_active":"2024-04-25T13:41:04.423569+0000","last_became_peered":"2024-04-25T13:41:04.423569+0000","last_unstale":"2024-04-25T13:47:01.700376+0000","last_undegraded":"2024-04-25T13:47:01.700376+0000","last_fullsized":"2024-04-25T13:47:01.700376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'558","reported_seq":577,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.569179+0000","last_change":"2024-04-25T13:41:03.426055+0000","last_active":"2024-04-25T13:46:38.569179+0000","last_peered":"2024-04-25T13:46:38.569179+0000","last_clean":"2024-04-25T13:46:38.569179+0000","last_became_active":"2024-04-25T13:41:03.424990+0000","last_became_peered":"2024-04-25T13:41:03.424990+0000","last_unstale":"2024-04-25T13:46:38.569179+0000","last_undegraded":"2024-04-25T13:46:38.569179+0000","last_fullsized":"2024-04-25T13:46:38.569179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'65","reported_seq":83,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700984+0000","last_change":"2024-04-25T13:41:04.430564+0000","last_active":"2024-04-25T13:47:01.700984+0000","last_peered":"2024-04-25T13:47:01.700984+0000","last_clean":"2024-04-25T13:47:01.700984+0000","last_became_active":"2024-04-25T13:41:04.427802+0000","last_became_peered":"2024-04-25T13:41:04.427802+0000","last_unstale":"2024-04-25T13:47:01.700984+0000","last_undegraded":"2024-04-25T13:47:01.700984+0000","last_fullsized":"2024-04-25T13:47:01.700984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'1525","reported_seq":1545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.553532+0000","last_change":"2024-04-25T13:41:03.422851+0000","last_active":"2024-04-25T13:46:38.553532+0000","last_peered":"2024-04-25T13:46:38.553532+0000","last_clean":"2024-04-25T13:46:38.553532+0000","last_became_active":"2024-04-25T13:41:03.422529+0000","last_became_peered":"2024-04-25T13:41:03.422529+0000","last_unstale":"2024-04-25T13:46:38.553532+0000","last_undegraded":"2024-04-25T13:46:38.553532+0000","last_fullsized":"2024-04-25T13:46:38.553532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1414,"num_write_kb":8966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689666+0000","last_change":"2024-04-25T13:41:04.429077+0000","last_active":"2024-04-25T13:47:01.689666+0000","last_peered":"2024-04-25T13:47:01.689666+0000","last_clean":"2024-04-25T13:47:01.689666+0000","last_became_active":"2024-04-25T13:41:04.428641+0000","last_became_peered":"2024-04-25T13:41:04.428641+0000","last_unstale":"2024-04-25T13:47:01.689666+0000","last_undegraded":"2024-04-25T13:47:01.689666+0000","last_fullsized":"2024-04-25T13:47:01.689666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'125","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.555214+0000","last_change":"2024-04-25T13:41:03.450649+0000","last_active":"2024-04-25T13:46:39.555214+0000","last_peered":"2024-04-25T13:46:39.555214+0000","last_clean":"2024-04-25T13:46:39.555214+0000","last_became_active":"2024-04-25T13:41:03.449872+0000","last_became_peered":"2024-04-25T13:41:03.449872+0000","last_unstale":"2024-04-25T13:46:39.555214+0000","last_undegraded":"2024-04-25T13:46:39.555214+0000","last_fullsized":"2024-04-25T13:46:39.555214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'85","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.677702+0000","last_change":"2024-04-25T13:41:51.580092+0000","last_active":"2024-04-25T13:47:01.677702+0000","last_peered":"2024-04-25T13:47:01.677702+0000","last_clean":"2024-04-25T13:47:01.677702+0000","last_became_active":"2024-04-25T13:41:51.578950+0000","last_became_peered":"2024-04-25T13:41:51.578950+0000","last_unstale":"2024-04-25T13:47:01.677702+0000","last_undegraded":"2024-04-25T13:47:01.677702+0000","last_fullsized":"2024-04-25T13:47:01.677702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"23'124","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:42.457078+0000","last_change":"2024-04-25T13:41:03.423826+0000","last_active":"2024-04-25T13:45:42.457078+0000","last_peered":"2024-04-25T13:45:42.457078+0000","last_clean":"2024-04-25T13:45:42.457078+0000","last_became_active":"2024-04-25T13:41:03.423037+0000","last_became_peered":"2024-04-25T13:41:03.423037+0000","last_unstale":"2024-04-25T13:45:42.457078+0000","last_undegraded":"2024-04-25T13:45:42.457078+0000","last_fullsized":"2024-04-25T13:45:42.457078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'91","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695393+0000","last_change":"2024-04-25T13:41:04.429831+0000","last_active":"2024-04-25T13:47:01.695393+0000","last_peered":"2024-04-25T13:47:01.695393+0000","last_clean":"2024-04-25T13:47:01.695393+0000","last_became_active":"2024-04-25T13:41:04.429110+0000","last_became_peered":"2024-04-25T13:41:04.429110+0000","last_unstale":"2024-04-25T13:47:01.695393+0000","last_undegraded":"2024-04-25T13:47:01.695393+0000","last_fullsized":"2024-04-25T13:47:01.695393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'134","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:42.452354+0000","last_change":"2024-04-25T13:41:03.409148+0000","last_active":"2024-04-25T13:45:42.452354+0000","last_peered":"2024-04-25T13:45:42.452354+0000","last_clean":"2024-04-25T13:45:42.452354+0000","last_became_active":"2024-04-25T13:41:03.408414+0000","last_became_peered":"2024-04-25T13:41:03.408414+0000","last_unstale":"2024-04-25T13:45:42.452354+0000","last_undegraded":"2024-04-25T13:45:42.452354+0000","last_fullsized":"2024-04-25T13:45:42.452354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'94","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707955+0000","last_change":"2024-04-25T13:41:04.426477+0000","last_active":"2024-04-25T13:47:01.707955+0000","last_peered":"2024-04-25T13:47:01.707955+0000","last_clean":"2024-04-25T13:47:01.707955+0000","last_became_active":"2024-04-25T13:41:04.425891+0000","last_became_peered":"2024-04-25T13:41:04.425891+0000","last_unstale":"2024-04-25T13:47:01.707955+0000","last_undegraded":"2024-04-25T13:47:01.707955+0000","last_fullsized":"2024-04-25T13:47:01.707955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'118","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.571270+0000","last_change":"2024-04-25T13:41:03.421716+0000","last_active":"2024-04-25T13:46:38.571270+0000","last_peered":"2024-04-25T13:46:38.571270+0000","last_clean":"2024-04-25T13:46:38.571270+0000","last_became_active":"2024-04-25T13:41:03.420848+0000","last_became_peered":"2024-04-25T13:41:03.420848+0000","last_unstale":"2024-04-25T13:46:38.571270+0000","last_undegraded":"2024-04-25T13:46:38.571270+0000","last_fullsized":"2024-04-25T13:46:38.571270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.389116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706476+0000","last_change":"2024-04-25T13:41:04.429840+0000","last_active":"2024-04-25T13:47:01.706476+0000","last_peered":"2024-04-25T13:47:01.706476+0000","last_clean":"2024-04-25T13:47:01.706476+0000","last_became_active":"2024-04-25T13:41:04.429404+0000","last_became_peered":"2024-04-25T13:41:04.429404+0000","last_unstale":"2024-04-25T13:47:01.706476+0000","last_undegraded":"2024-04-25T13:47:01.706476+0000","last_fullsized":"2024-04-25T13:47:01.706476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'106","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:32.450719+0000","last_change":"2024-04-25T13:41:03.415723+0000","last_active":"2024-04-25T13:45:32.450719+0000","last_peered":"2024-04-25T13:45:32.450719+0000","last_clean":"2024-04-25T13:45:32.450719+0000","last_became_active":"2024-04-25T13:41:03.414957+0000","last_became_peered":"2024-04-25T13:41:03.414957+0000","last_unstale":"2024-04-25T13:45:32.450719+0000","last_undegraded":"2024-04-25T13:45:32.450719+0000","last_fullsized":"2024-04-25T13:45:32.450719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.708064+0000","last_change":"2024-04-25T13:41:04.434675+0000","last_active":"2024-04-25T13:47:01.708064+0000","last_peered":"2024-04-25T13:47:01.708064+0000","last_clean":"2024-04-25T13:47:01.708064+0000","last_became_active":"2024-04-25T13:41:04.434194+0000","last_became_peered":"2024-04-25T13:41:04.434194+0000","last_unstale":"2024-04-25T13:47:01.708064+0000","last_undegraded":"2024-04-25T13:47:01.708064+0000","last_fullsized":"2024-04-25T13:47:01.708064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'576","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.554602+0000","last_change":"2024-04-25T13:41:03.402131+0000","last_active":"2024-04-25T13:46:38.554602+0000","last_peered":"2024-04-25T13:46:38.554602+0000","last_clean":"2024-04-25T13:46:38.554602+0000","last_became_active":"2024-04-25T13:41:03.401398+0000","last_became_peered":"2024-04-25T13:41:03.401398+0000","last_unstale":"2024-04-25T13:46:38.554602+0000","last_undegraded":"2024-04-25T13:46:38.554602+0000","last_fullsized":"2024-04-25T13:46:38.554602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":4320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'92","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704161+0000","last_change":"2024-04-25T13:41:04.418743+0000","last_active":"2024-04-25T13:47:01.704161+0000","last_peered":"2024-04-25T13:47:01.704161+0000","last_clean":"2024-04-25T13:47:01.704161+0000","last_became_active":"2024-04-25T13:41:04.417963+0000","last_became_peered":"2024-04-25T13:41:04.417963+0000","last_unstale":"2024-04-25T13:47:01.704161+0000","last_undegraded":"2024-04-25T13:47:01.704161+0000","last_fullsized":"2024-04-25T13:47:01.704161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'134","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:32.450666+0000","last_change":"2024-04-25T13:41:03.445729+0000","last_active":"2024-04-25T13:45:32.450666+0000","last_peered":"2024-04-25T13:45:32.450666+0000","last_clean":"2024-04-25T13:45:32.450666+0000","last_became_active":"2024-04-25T13:41:03.445293+0000","last_became_peered":"2024-04-25T13:41:03.445293+0000","last_unstale":"2024-04-25T13:45:32.450666+0000","last_undegraded":"2024-04-25T13:45:32.450666+0000","last_fullsized":"2024-04-25T13:45:32.450666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'92","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707261+0000","last_change":"2024-04-25T13:41:51.966509+0000","last_active":"2024-04-25T13:47:01.707261+0000","last_peered":"2024-04-25T13:47:01.707261+0000","last_clean":"2024-04-25T13:47:01.707261+0000","last_became_active":"2024-04-25T13:41:51.965867+0000","last_became_peered":"2024-04-25T13:41:51.965867+0000","last_unstale":"2024-04-25T13:47:01.707261+0000","last_undegraded":"2024-04-25T13:47:01.707261+0000","last_fullsized":"2024-04-25T13:47:01.707261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:14.462796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:02.451274+0000","last_change":"2024-04-25T13:41:00.175142+0000","last_active":"2024-04-25T13:45:02.451274+0000","last_peered":"2024-04-25T13:45:02.451274+0000","last_clean":"2024-04-25T13:45:02.451274+0000","last_became_active":"2024-04-25T13:41:00.172906+0000","last_became_peered":"2024-04-25T13:41:00.172906+0000","last_unstale":"2024-04-25T13:45:02.451274+0000","last_undegraded":"2024-04-25T13:45:02.451274+0000","last_fullsized":"2024-04-25T13:45:02.451274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_clean_scrub_stamp":"2024-04-25T13:40:59.093070+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:38.020124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'122","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.560972+0000","last_change":"2024-04-25T13:41:03.438420+0000","last_active":"2024-04-25T13:46:39.560972+0000","last_peered":"2024-04-25T13:46:39.560972+0000","last_clean":"2024-04-25T13:46:39.560972+0000","last_became_active":"2024-04-25T13:41:03.437569+0000","last_became_peered":"2024-04-25T13:41:03.437569+0000","last_unstale":"2024-04-25T13:46:39.560972+0000","last_undegraded":"2024-04-25T13:46:39.560972+0000","last_fullsized":"2024-04-25T13:46:39.560972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.703768+0000","last_change":"2024-04-25T13:41:04.417328+0000","last_active":"2024-04-25T13:47:01.703768+0000","last_peered":"2024-04-25T13:47:01.703768+0000","last_clean":"2024-04-25T13:47:01.703768+0000","last_became_active":"2024-04-25T13:41:04.416666+0000","last_became_peered":"2024-04-25T13:41:04.416666+0000","last_unstale":"2024-04-25T13:47:01.703768+0000","last_undegraded":"2024-04-25T13:47:01.703768+0000","last_fullsized":"2024-04-25T13:47:01.703768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'1393","reported_seq":1414,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.567347+0000","last_change":"2024-04-25T13:41:03.431855+0000","last_active":"2024-04-25T13:46:38.567347+0000","last_peered":"2024-04-25T13:46:38.567347+0000","last_clean":"2024-04-25T13:46:38.567347+0000","last_became_active":"2024-04-25T13:41:03.429200+0000","last_became_peered":"2024-04-25T13:41:03.429200+0000","last_unstale":"2024-04-25T13:46:38.567347+0000","last_undegraded":"2024-04-25T13:46:38.567347+0000","last_fullsized":"2024-04-25T13:46:38.567347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1393,"log_dups_size":0,"ondisk_log_size":1393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1260,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.672770+0000","last_change":"2024-04-25T13:41:04.411548+0000","last_active":"2024-04-25T13:47:01.672770+0000","last_peered":"2024-04-25T13:47:01.672770+0000","last_clean":"2024-04-25T13:47:01.672770+0000","last_became_active":"2024-04-25T13:41:04.400093+0000","last_became_peered":"2024-04-25T13:41:04.400093+0000","last_unstale":"2024-04-25T13:47:01.672770+0000","last_undegraded":"2024-04-25T13:47:01.672770+0000","last_fullsized":"2024-04-25T13:47:01.672770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:09.999429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'425","reported_seq":750,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.545454+0000","last_change":"2024-04-25T13:41:03.415949+0000","last_active":"2024-04-25T13:46:39.545454+0000","last_peered":"2024-04-25T13:46:39.545454+0000","last_clean":"2024-04-25T13:46:39.545454+0000","last_became_active":"2024-04-25T13:41:03.414899+0000","last_became_peered":"2024-04-25T13:41:03.414899+0000","last_unstale":"2024-04-25T13:46:39.545454+0000","last_undegraded":"2024-04-25T13:46:39.545454+0000","last_fullsized":"2024-04-25T13:46:39.545454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":769923,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":305,"num_write_kb":953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'94","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698710+0000","last_change":"2024-04-25T13:41:04.403032+0000","last_active":"2024-04-25T13:47:01.698710+0000","last_peered":"2024-04-25T13:47:01.698710+0000","last_clean":"2024-04-25T13:47:01.698710+0000","last_became_active":"2024-04-25T13:41:04.402055+0000","last_became_peered":"2024-04-25T13:41:04.402055+0000","last_unstale":"2024-04-25T13:47:01.698710+0000","last_undegraded":"2024-04-25T13:47:01.698710+0000","last_fullsized":"2024-04-25T13:47:01.698710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1421","reported_seq":1441,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.572981+0000","last_change":"2024-04-25T13:41:03.447547+0000","last_active":"2024-04-25T13:46:38.572981+0000","last_peered":"2024-04-25T13:46:38.572981+0000","last_clean":"2024-04-25T13:46:38.572981+0000","last_became_active":"2024-04-25T13:41:03.444429+0000","last_became_peered":"2024-04-25T13:41:03.444429+0000","last_unstale":"2024-04-25T13:46:38.572981+0000","last_undegraded":"2024-04-25T13:46:38.572981+0000","last_fullsized":"2024-04-25T13:46:38.572981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1421,"log_dups_size":0,"ondisk_log_size":1421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.667955+0000","last_change":"2024-04-25T13:41:04.398647+0000","last_active":"2024-04-25T13:47:01.667955+0000","last_peered":"2024-04-25T13:47:01.667955+0000","last_clean":"2024-04-25T13:47:01.667955+0000","last_became_active":"2024-04-25T13:41:04.398287+0000","last_became_peered":"2024-04-25T13:41:04.398287+0000","last_unstale":"2024-04-25T13:47:01.667955+0000","last_undegraded":"2024-04-25T13:47:01.667955+0000","last_fullsized":"2024-04-25T13:47:01.667955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:06.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'115","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.107845+0000","last_change":"2024-04-25T13:41:03.414535+0000","last_active":"2024-04-25T13:45:30.107845+0000","last_peered":"2024-04-25T13:45:30.107845+0000","last_clean":"2024-04-25T13:45:30.107845+0000","last_became_active":"2024-04-25T13:41:03.414145+0000","last_became_peered":"2024-04-25T13:41:03.414145+0000","last_unstale":"2024-04-25T13:45:30.107845+0000","last_undegraded":"2024-04-25T13:45:30.107845+0000","last_fullsized":"2024-04-25T13:45:30.107845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'92","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.703641+0000","last_change":"2024-04-25T13:41:04.419186+0000","last_active":"2024-04-25T13:47:01.703641+0000","last_peered":"2024-04-25T13:47:01.703641+0000","last_clean":"2024-04-25T13:47:01.703641+0000","last_became_active":"2024-04-25T13:41:04.417831+0000","last_became_peered":"2024-04-25T13:41:04.417831+0000","last_unstale":"2024-04-25T13:47:01.703641+0000","last_undegraded":"2024-04-25T13:47:01.703641+0000","last_fullsized":"2024-04-25T13:47:01.703641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'105","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.560065+0000","last_change":"2024-04-25T13:41:03.424206+0000","last_active":"2024-04-25T13:46:38.560065+0000","last_peered":"2024-04-25T13:46:38.560065+0000","last_clean":"2024-04-25T13:46:38.560065+0000","last_became_active":"2024-04-25T13:41:03.423176+0000","last_became_peered":"2024-04-25T13:41:03.423176+0000","last_unstale":"2024-04-25T13:46:38.560065+0000","last_undegraded":"2024-04-25T13:46:38.560065+0000","last_fullsized":"2024-04-25T13:46:38.560065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:23.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'78","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.697730+0000","last_change":"2024-04-25T13:41:04.402353+0000","last_active":"2024-04-25T13:47:01.697730+0000","last_peered":"2024-04-25T13:47:01.697730+0000","last_clean":"2024-04-25T13:47:01.697730+0000","last_became_active":"2024-04-25T13:41:04.402014+0000","last_became_peered":"2024-04-25T13:41:04.402014+0000","last_unstale":"2024-04-25T13:47:01.697730+0000","last_undegraded":"2024-04-25T13:47:01.697730+0000","last_fullsized":"2024-04-25T13:47:01.697730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'358","reported_seq":378,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:42.615289+0000","last_change":"2024-04-25T13:41:03.439449+0000","last_active":"2024-04-25T13:46:42.615289+0000","last_peered":"2024-04-25T13:46:42.615289+0000","last_clean":"2024-04-25T13:46:42.615289+0000","last_became_active":"2024-04-25T13:41:03.439074+0000","last_became_peered":"2024-04-25T13:41:03.439074+0000","last_unstale":"2024-04-25T13:46:42.615289+0000","last_undegraded":"2024-04-25T13:46:42.615289+0000","last_fullsized":"2024-04-25T13:46:42.615289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.699026+0000","last_change":"2024-04-25T13:41:04.418630+0000","last_active":"2024-04-25T13:47:01.699026+0000","last_peered":"2024-04-25T13:47:01.699026+0000","last_clean":"2024-04-25T13:47:01.699026+0000","last_became_active":"2024-04-25T13:41:04.418330+0000","last_became_peered":"2024-04-25T13:41:04.418330+0000","last_unstale":"2024-04-25T13:47:01.699026+0000","last_undegraded":"2024-04-25T13:47:01.699026+0000","last_fullsized":"2024-04-25T13:47:01.699026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'120","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.106212+0000","last_change":"2024-04-25T13:41:03.435851+0000","last_active":"2024-04-25T13:45:30.106212+0000","last_peered":"2024-04-25T13:45:30.106212+0000","last_clean":"2024-04-25T13:45:30.106212+0000","last_became_active":"2024-04-25T13:41:03.434870+0000","last_became_peered":"2024-04-25T13:41:03.434870+0000","last_unstale":"2024-04-25T13:45:30.106212+0000","last_undegraded":"2024-04-25T13:45:30.106212+0000","last_fullsized":"2024-04-25T13:45:30.106212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705633+0000","last_change":"2024-04-25T13:41:04.426962+0000","last_active":"2024-04-25T13:47:01.705633+0000","last_peered":"2024-04-25T13:47:01.705633+0000","last_clean":"2024-04-25T13:47:01.705633+0000","last_became_active":"2024-04-25T13:41:04.426424+0000","last_became_peered":"2024-04-25T13:41:04.426424+0000","last_unstale":"2024-04-25T13:47:01.705633+0000","last_undegraded":"2024-04-25T13:47:01.705633+0000","last_fullsized":"2024-04-25T13:47:01.705633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'654","reported_seq":674,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.565821+0000","last_change":"2024-04-25T13:41:03.430095+0000","last_active":"2024-04-25T13:46:38.565821+0000","last_peered":"2024-04-25T13:46:38.565821+0000","last_clean":"2024-04-25T13:46:38.565821+0000","last_became_active":"2024-04-25T13:41:03.429094+0000","last_became_peered":"2024-04-25T13:41:03.429094+0000","last_unstale":"2024-04-25T13:46:38.565821+0000","last_undegraded":"2024-04-25T13:46:38.565821+0000","last_fullsized":"2024-04-25T13:46:38.565821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'81","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.679923+0000","last_change":"2024-04-25T13:41:04.413097+0000","last_active":"2024-04-25T13:47:01.679923+0000","last_peered":"2024-04-25T13:47:01.679923+0000","last_clean":"2024-04-25T13:47:01.679923+0000","last_became_active":"2024-04-25T13:41:04.412572+0000","last_became_peered":"2024-04-25T13:41:04.412572+0000","last_unstale":"2024-04-25T13:47:01.679923+0000","last_undegraded":"2024-04-25T13:47:01.679923+0000","last_fullsized":"2024-04-25T13:47:01.679923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:50.740570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'126","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.557989+0000","last_change":"2024-04-25T13:41:03.411890+0000","last_active":"2024-04-25T13:46:38.557989+0000","last_peered":"2024-04-25T13:46:38.557989+0000","last_clean":"2024-04-25T13:46:38.557989+0000","last_became_active":"2024-04-25T13:41:03.411481+0000","last_became_peered":"2024-04-25T13:41:03.411481+0000","last_unstale":"2024-04-25T13:46:38.557989+0000","last_undegraded":"2024-04-25T13:46:38.557989+0000","last_fullsized":"2024-04-25T13:46:38.557989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'90","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702621+0000","last_change":"2024-04-25T13:41:04.408896+0000","last_active":"2024-04-25T13:47:01.702621+0000","last_peered":"2024-04-25T13:47:01.702621+0000","last_clean":"2024-04-25T13:47:01.702621+0000","last_became_active":"2024-04-25T13:41:04.408517+0000","last_became_peered":"2024-04-25T13:41:04.408517+0000","last_unstale":"2024-04-25T13:47:01.702621+0000","last_undegraded":"2024-04-25T13:47:01.702621+0000","last_fullsized":"2024-04-25T13:47:01.702621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'128","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:34.111762+0000","last_change":"2024-04-25T13:41:03.408129+0000","last_active":"2024-04-25T13:45:34.111762+0000","last_peered":"2024-04-25T13:45:34.111762+0000","last_clean":"2024-04-25T13:45:34.111762+0000","last_became_active":"2024-04-25T13:41:03.407713+0000","last_became_peered":"2024-04-25T13:41:03.407713+0000","last_unstale":"2024-04-25T13:45:34.111762+0000","last_undegraded":"2024-04-25T13:45:34.111762+0000","last_fullsized":"2024-04-25T13:45:34.111762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'94","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702570+0000","last_change":"2024-04-25T13:41:04.424601+0000","last_active":"2024-04-25T13:47:01.702570+0000","last_peered":"2024-04-25T13:47:01.702570+0000","last_clean":"2024-04-25T13:47:01.702570+0000","last_became_active":"2024-04-25T13:41:04.424153+0000","last_became_peered":"2024-04-25T13:41:04.424153+0000","last_unstale":"2024-04-25T13:47:01.702570+0000","last_undegraded":"2024-04-25T13:47:01.702570+0000","last_fullsized":"2024-04-25T13:47:01.702570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'576","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.562196+0000","last_change":"2024-04-25T13:41:03.431525+0000","last_active":"2024-04-25T13:46:39.562196+0000","last_peered":"2024-04-25T13:46:39.562196+0000","last_clean":"2024-04-25T13:46:39.562196+0000","last_became_active":"2024-04-25T13:41:03.430716+0000","last_became_peered":"2024-04-25T13:41:03.430716+0000","last_unstale":"2024-04-25T13:46:39.562196+0000","last_undegraded":"2024-04-25T13:46:39.562196+0000","last_fullsized":"2024-04-25T13:46:39.562196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:46.480379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'75","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.675680+0000","last_change":"2024-04-25T13:41:04.424614+0000","last_active":"2024-04-25T13:47:01.675680+0000","last_peered":"2024-04-25T13:47:01.675680+0000","last_clean":"2024-04-25T13:47:01.675680+0000","last_became_active":"2024-04-25T13:41:04.424248+0000","last_became_peered":"2024-04-25T13:41:04.424248+0000","last_unstale":"2024-04-25T13:47:01.675680+0000","last_undegraded":"2024-04-25T13:47:01.675680+0000","last_fullsized":"2024-04-25T13:47:01.675680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.682341+0000","last_change":"2024-04-25T13:41:04.425893+0000","last_active":"2024-04-25T13:47:01.682341+0000","last_peered":"2024-04-25T13:47:01.682341+0000","last_clean":"2024-04-25T13:47:01.682341+0000","last_became_active":"2024-04-25T13:41:04.424475+0000","last_became_peered":"2024-04-25T13:41:04.424475+0000","last_unstale":"2024-04-25T13:47:01.682341+0000","last_undegraded":"2024-04-25T13:47:01.682341+0000","last_fullsized":"2024-04-25T13:47:01.682341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'113","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.560700+0000","last_change":"2024-04-25T13:41:03.447296+0000","last_active":"2024-04-25T13:46:39.560700+0000","last_peered":"2024-04-25T13:46:39.560700+0000","last_clean":"2024-04-25T13:46:39.560700+0000","last_became_active":"2024-04-25T13:41:03.446522+0000","last_became_peered":"2024-04-25T13:41:03.446522+0000","last_unstale":"2024-04-25T13:46:39.560700+0000","last_undegraded":"2024-04-25T13:46:39.560700+0000","last_fullsized":"2024-04-25T13:46:39.560700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'74","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692806+0000","last_change":"2024-04-25T13:41:04.424211+0000","last_active":"2024-04-25T13:47:01.692806+0000","last_peered":"2024-04-25T13:47:01.692806+0000","last_clean":"2024-04-25T13:47:01.692806+0000","last_became_active":"2024-04-25T13:41:04.423899+0000","last_became_peered":"2024-04-25T13:41:04.423899+0000","last_unstale":"2024-04-25T13:47:01.692806+0000","last_undegraded":"2024-04-25T13:47:01.692806+0000","last_fullsized":"2024-04-25T13:47:01.692806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'992","reported_seq":1012,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.571565+0000","last_change":"2024-04-25T13:41:03.441717+0000","last_active":"2024-04-25T13:46:38.571565+0000","last_peered":"2024-04-25T13:46:38.571565+0000","last_clean":"2024-04-25T13:46:38.571565+0000","last_became_active":"2024-04-25T13:41:03.440886+0000","last_became_peered":"2024-04-25T13:41:03.440886+0000","last_unstale":"2024-04-25T13:46:38.571565+0000","last_undegraded":"2024-04-25T13:46:38.571565+0000","last_fullsized":"2024-04-25T13:46:38.571565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":8413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'76","reported_seq":94,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.691789+0000","last_change":"2024-04-25T13:41:04.423577+0000","last_active":"2024-04-25T13:47:01.691789+0000","last_peered":"2024-04-25T13:47:01.691789+0000","last_clean":"2024-04-25T13:47:01.691789+0000","last_became_active":"2024-04-25T13:41:04.422496+0000","last_became_peered":"2024-04-25T13:41:04.422496+0000","last_unstale":"2024-04-25T13:47:01.691789+0000","last_undegraded":"2024-04-25T13:47:01.691789+0000","last_fullsized":"2024-04-25T13:47:01.691789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'430","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.550665+0000","last_change":"2024-04-25T13:41:03.418067+0000","last_active":"2024-04-25T13:46:39.550665+0000","last_peered":"2024-04-25T13:46:39.550665+0000","last_clean":"2024-04-25T13:46:39.550665+0000","last_became_active":"2024-04-25T13:41:03.417592+0000","last_became_peered":"2024-04-25T13:41:03.417592+0000","last_unstale":"2024-04-25T13:46:39.550665+0000","last_undegraded":"2024-04-25T13:46:39.550665+0000","last_fullsized":"2024-04-25T13:46:39.550665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'82","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.693266+0000","last_change":"2024-04-25T13:41:04.410387+0000","last_active":"2024-04-25T13:47:01.693266+0000","last_peered":"2024-04-25T13:47:01.693266+0000","last_clean":"2024-04-25T13:47:01.693266+0000","last_became_active":"2024-04-25T13:41:04.410065+0000","last_became_peered":"2024-04-25T13:41:04.410065+0000","last_unstale":"2024-04-25T13:47:01.693266+0000","last_undegraded":"2024-04-25T13:47:01.693266+0000","last_fullsized":"2024-04-25T13:47:01.693266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'435","reported_seq":455,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.107587+0000","last_change":"2024-04-25T13:41:03.425103+0000","last_active":"2024-04-25T13:45:30.107587+0000","last_peered":"2024-04-25T13:45:30.107587+0000","last_clean":"2024-04-25T13:45:30.107587+0000","last_became_active":"2024-04-25T13:41:03.424688+0000","last_became_peered":"2024-04-25T13:41:03.424688+0000","last_unstale":"2024-04-25T13:45:30.107587+0000","last_undegraded":"2024-04-25T13:45:30.107587+0000","last_fullsized":"2024-04-25T13:45:30.107587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:51.359222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75674842,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":10892,"num_write_kb":79992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113328128,"data_stored":151349684,"data_compressed":10339548,"data_compressed_allocated":20144128,"data_compressed_original":58220544,"omap_allocated":0,"internal_metadata":0},"log_size":14453,"ondisk_log_size":14453,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95428,"kb_used_data":23996,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276412,"statfs":{"total":96636764160,"available":96539045888,"internally_reserved":0,"allocated":24571904,"data_stored":34233256,"data_compressed":2467561,"data_compressed_allocated":4726784,"data_compressed_original":14548992,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50572,"kb_used_data":11076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321268,"statfs":{"total":96636764160,"available":96584978432,"internally_reserved":0,"allocated":11341824,"data_stored":16865762,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58792,"kb_used_data":13728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94313048,"statfs":{"total":96636764160,"available":96576561152,"internally_reserved":0,"allocated":14057472,"data_stored":16271157,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89060,"kb_used_data":21788,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94282780,"statfs":{"total":96636764160,"available":96545566720,"internally_reserved":0,"allocated":22310912,"data_stored":28854105,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":10256384,"data_stored":13441381,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":857797,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65576,"kb_used_data":16352,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94306264,"statfs":{"total":96636764160,"available":96569614336,"internally_reserved":0,"allocated":16744448,"data_stored":21059554,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":14784,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":15138816,"data_stored":21650400,"data_compressed":1741521,"data_compressed_allocated":3354624,"data_compressed_original":10035200,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":20972158,"data_compressed":1708275,"data_compressed_allocated":3309568,"data_compressed_original":9461760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16502784,"data_stored":20971680,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":769923,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":13353507,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":28766231,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13815808,"data_stored":16183283,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11100160,"data_stored":16777888,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24264704,"data_stored":33555014,"data_compressed":2434315,"data_compressed_allocated":4681728,"data_compressed_original":13975552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:47:09.595 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:47:09.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4bb82640 1 Processor -- start 2024-04-25T13:47:09.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4bb82640 1 -- start start 2024-04-25T13:47:09.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4bb82640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c440742d0 0x7f6c4406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4bb82640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c440a9330 con 0x7f6c440a8f20 2024-04-25T13:47:09.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4bb82640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c44074c30 con 0x7f6c44074820 2024-04-25T13:47:09.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4bb82640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4406cd80 con 0x7f6c440742d0 2024-04-25T13:47:09.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4991e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6c440a8f20 0x7f6c44151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55286/0 (socket says 172.21.15.77:55286) 2024-04-25T13:47:09.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4991e640 1 -- 172.21.15.77:0/702672655 learned_addr learned my addr 172.21.15.77:0/702672655 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:09.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4a11f640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c440742d0 0x7f6c4406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3988896457 0 0) 0x7f6c40001120 con 0x7f6c440a8f20 2024-04-25T13:47:09.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c30003530 con 0x7f6c440a8f20 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1789792574 0 0) 0x7f6c30003530 con 0x7f6c440a8f20 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c440742d0 msgr2=0x7f6c4406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c440742d0 0x7f6c4406c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 >> v1:172.21.15.96:6789/0 conn(0x7f6c44074820 legacy=0x7f6c44073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c44073800 con 0x7f6c440a8f20 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f6c40001850 con 0x7f6c440a8f20 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 >> v1:172.21.15.77:6789/0 conn(0x7f6c440a8f20 legacy=0x7f6c44151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c440742d0 0x7f6c300039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30003fc0 0x7f6c30004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c30004d50 0x7f6c300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4406cd80 con 0x7f6c30004d50 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3000bbc0 con 0x7f6c30003fc0 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3000bdc0 con 0x7f6c440742d0 2024-04-25T13:47:09.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4a11f640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c30004d50 0x7f6c300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4911d640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30003fc0 0x7f6c30004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4991e640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c440742d0 0x7f6c300039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4a11f640 1 -- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c440742d0 msgr2=0x7f6c300039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:09.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4a11f640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c440742d0 0x7f6c300039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4a11f640 1 -- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30003fc0 msgr2=0x7f6c30004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:09.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4a11f640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30003fc0 0x7f6c30004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4a11f640 1 -- 172.21.15.77:0/702672655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c30003530 con 0x7f6c30004d50 2024-04-25T13:47:09.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.782+0000 7f6c4991e640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c440742d0 0x7f6c300039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:09.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4a11f640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c30004d50 0x7f6c300051c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c440a87d0 tx=0x7f6c3c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e42a6d1daa41c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:09.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0b2070 con 0x7f6c30004d50 2024-04-25T13:47:09.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0a5c10 con 0x7f6c30004d50 2024-04-25T13:47:09.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4891c640 1 -- 172.21.15.77:0/702672655 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c009c10 con 0x7f6c30004d50 2024-04-25T13:47:09.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4bb82640 1 -- 172.21.15.77:0/702672655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c30004d50 msgr2=0x7f6c300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4bb82640 1 --2- 172.21.15.77:0/702672655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c30004d50 0x7f6c300051c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c440a87d0 tx=0x7f6c3c01cc00 comp rx=0 tx=0).stop 2024-04-25T13:47:09.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4a11f640 1 -- 172.21.15.77:0/702672655 reap_dead start 2024-04-25T13:47:09.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4bb82640 1 -- 172.21.15.77:0/702672655 shutdown_connections 2024-04-25T13:47:09.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4bb82640 1 -- 172.21.15.77:0/702672655 >> 172.21.15.77:0/702672655 conn(0x7f6c440c48b0 msgr2=0x7f6c440c4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:09.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4bb82640 1 -- 172.21.15.77:0/702672655 shutdown_connections 2024-04-25T13:47:09.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.786+0000 7f6c4bb82640 1 -- 172.21.15.77:0/702672655 wait complete. 2024-04-25T13:47:09.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 Processor -- start 2024-04-25T13:47:09.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 -- start start 2024-04-25T13:47:09.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30004d50 0x7f6c441de300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c44150240 0x7f6c441db500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c441dad20 0x7f6c440c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c440a7ef0 con 0x7f6c441dad20 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6c440a7c10 con 0x7f6c30004d50 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6c44152210 con 0x7f6c44150240 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4a11f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c441dad20 0x7f6c440c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4a11f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c441dad20 0x7f6c440c0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55002/0 (socket says 172.21.15.77:55002) 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4a11f640 1 -- 172.21.15.77:0/2267839887 learned_addr learned my addr 172.21.15.77:0/2267839887 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4911d640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c44150240 0x7f6c441db500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4991e640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30004d50 0x7f6c441de300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4a11f640 1 -- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c44150240 msgr2=0x7f6c441db500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4a11f640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c44150240 0x7f6c441db500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4a11f640 1 -- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30004d50 msgr2=0x7f6c441de300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4a11f640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30004d50 0x7f6c441de300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4a11f640 1 -- 172.21.15.77:0/2267839887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c441dba40 con 0x7f6c441dad20 2024-04-25T13:47:09.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4911d640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c44150240 0x7f6c441db500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:09.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4991e640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30004d50 0x7f6c441de300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:09.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4a11f640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c441dad20 0x7f6c440c0150 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c002240 tx=0x7f6c3c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:09.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c3a7fc640 1 -- 172.21.15.77:0/2267839887 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0b2040 con 0x7f6c441dad20 2024-04-25T13:47:09.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c3a7fc640 1 -- 172.21.15.77:0/2267839887 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0a5a10 con 0x7f6c441dad20 2024-04-25T13:47:09.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c440a3680 con 0x7f6c441dad20 2024-04-25T13:47:09.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c3a7fc640 1 -- 172.21.15.77:0/2267839887 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c009c10 con 0x7f6c441dad20 2024-04-25T13:47:09.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c440c0690 con 0x7f6c441dad20 2024-04-25T13:47:09.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.790+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c4406a280 con 0x7f6c441dad20 2024-04-25T13:47:09.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.794+0000 7f6c3a7fc640 1 -- 172.21.15.77:0/2267839887 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6c3c0be020 con 0x7f6c441dad20 2024-04-25T13:47:09.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.794+0000 7f6c3a7fc640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6c2806f400 0x7f6c28071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:09.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.794+0000 7f6c3a7fc640 1 -- 172.21.15.77:0/2267839887 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f6c3c129470 con 0x7f6c441dad20 2024-04-25T13:47:09.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.794+0000 7f6c4991e640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6c2806f400 0x7f6c28071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:09.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.794+0000 7f6c4991e640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6c2806f400 0x7f6c28071910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c400019c0 tx=0x7f6c40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:09.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.798+0000 7f6c3a7fc640 1 -- 172.21.15.77:0/2267839887 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6c3c0c5020 con 0x7f6c441dad20 2024-04-25T13:47:09.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.958+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c440c37e0 con 0x7f6c441dad20 2024-04-25T13:47:09.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.958+0000 7f6c3a7fc640 1 -- 172.21.15.77:0/2267839887 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16853 (secure 0 0 0) 0x7f6c3c016910 con 0x7f6c441dad20 2024-04-25T13:47:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:09.960 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:51.564949+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6c2806f400 msgr2=0x7f6c28071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6c2806f400 0x7f6c28071910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c400019c0 tx=0x7f6c40009040 comp rx=0 tx=0).stop 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c441dad20 msgr2=0x7f6c440c0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c441dad20 0x7f6c440c0150 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c002240 tx=0x7f6c3c009750 comp rx=0 tx=0).stop 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 shutdown_connections 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6c2806f400 0x7f6c28071910 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c441dad20 0x7f6c440c0150 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6c44150240 0x7f6c441db500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 --2- 172.21.15.77:0/2267839887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c30004d50 0x7f6c441de300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 >> 172.21.15.77:0/2267839887 conn(0x7f6c440c48b0 msgr2=0x7f6c440c3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 shutdown_connections 2024-04-25T13:47:09.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:09.962+0000 7f6c4bb82640 1 -- 172.21.15.77:0/2267839887 wait complete. 2024-04-25T13:47:10.981 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T13:47:10.981 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:47:11.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.146+0000 7fd8f4345640 1 Processor -- start 2024-04-25T13:47:11.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.146+0000 7fd8f4345640 1 -- start start 2024-04-25T13:47:11.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f4345640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd8ec14f600 0x7fd8ec14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f4345640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8ec0a6b70 con 0x7fd8ec1505e0 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f4345640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8ec0a6e50 con 0x7fd8ec073d70 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f4345640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd8ec0a75f0 con 0x7fd8ec14f600 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f28e2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd8ec1505e0 0x7fd8ec1509f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46604/0 (socket says 172.21.15.77:46604) 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f28e2640 1 -- 172.21.15.77:0/3258412592 learned_addr learned my addr 172.21.15.77:0/3258412592 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f18e0640 1 --2- 172.21.15.77:0/3258412592 >> v2:172.21.15.96:3300/0 conn(0x7fd8ec14f600 0x7fd8ec14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324525947 0 0) 0x7fd8ec0a6b70 con 0x7fd8ec1505e0 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8d8003530 con 0x7fd8ec1505e0 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1695714360 0 0) 0x7fd8d8003530 con 0x7fd8ec1505e0 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 >> v2:172.21.15.96:3300/0 conn(0x7fd8ec14f600 msgr2=0x7fd8ec14fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 --2- 172.21.15.77:0/3258412592 >> v2:172.21.15.96:3300/0 conn(0x7fd8ec14f600 0x7fd8ec14fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 >> v1:172.21.15.96:6789/0 conn(0x7fd8ec073d70 legacy=0x7fd8ec06f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec074180 con 0x7fd8ec1505e0 2024-04-25T13:47:11.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fd8e4001a00 con 0x7fd8ec1505e0 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 >> v1:172.21.15.77:6789/0 conn(0x7fd8ec1505e0 legacy=0x7fd8ec1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8d80039c0 0x7fd8d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8d8004810 0x7fd8d8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d800c140 con 0x7fd8d80051d0 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d800c2f0 con 0x7fd8d80039c0 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d800c4f0 con 0x7fd8d8004810 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f28e2640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f20e1640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8d80039c0 0x7fd8d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f18e0640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8d8004810 0x7fd8d8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f28e2640 1 -- 172.21.15.77:0/3258412592 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8d8004810 msgr2=0x7fd8d8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f28e2640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8d8004810 0x7fd8d8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f28e2640 1 -- 172.21.15.77:0/3258412592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8d80039c0 msgr2=0x7fd8d8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f28e2640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8d80039c0 0x7fd8d8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f28e2640 1 -- 172.21.15.77:0/3258412592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d8003530 con 0x7fd8d80051d0 2024-04-25T13:47:11.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.150+0000 7fd8f18e0640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8d8004810 0x7fd8d8004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f28e2640 1 -- 172.21.15.77:0/3258412592 reap_dead start 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f28e2640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8d800b9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400a850 tx=0x7fd8e401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de506c38eaa3e801 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400a4a0 con 0x7fd8d80051d0 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e40ad650 con 0x7fd8d80051d0 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f10df640 1 -- 172.21.15.77:0/3258412592 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40ada40 con 0x7fd8d80051d0 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f4345640 1 -- 172.21.15.77:0/3258412592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 msgr2=0x7fd8d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f4345640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8d800b9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400a850 tx=0x7fd8e401d2e0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f4345640 1 -- 172.21.15.77:0/3258412592 shutdown_connections 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f4345640 1 --2- 172.21.15.77:0/3258412592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8d800b9d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f4345640 1 -- 172.21.15.77:0/3258412592 >> 172.21.15.77:0/3258412592 conn(0x7fd8ec0c37a0 msgr2=0x7fd8ec0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f4345640 1 -- 172.21.15.77:0/3258412592 shutdown_connections 2024-04-25T13:47:11.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f4345640 1 -- 172.21.15.77:0/3258412592 wait complete. 2024-04-25T13:47:11.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f4345640 1 Processor -- start 2024-04-25T13:47:11.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.154+0000 7fd8f4345640 1 -- start start 2024-04-25T13:47:11.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f4345640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8ec14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f4345640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8ec1e77c0 0x7fd8ec0bfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f4345640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8ec0c00d0 0x7fd8ec1e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f4345640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec06fb70 con 0x7fd8d80051d0 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f4345640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec06f9f0 con 0x7fd8ec1e77c0 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f4345640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ec06fcf0 con 0x7fd8ec0c00d0 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f20e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8ec14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f20e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8ec14e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60532/0 (socket says 172.21.15.77:60532) 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f20e1640 1 -- 172.21.15.77:0/2433691881 learned_addr learned my addr 172.21.15.77:0/2433691881 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f28e2640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8ec0c00d0 0x7fd8ec1e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f18e0640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8ec1e77c0 0x7fd8ec0bfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f20e1640 1 -- 172.21.15.77:0/2433691881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8ec0c00d0 msgr2=0x7fd8ec1e3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f20e1640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8ec0c00d0 0x7fd8ec1e3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f20e1640 1 -- 172.21.15.77:0/2433691881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8ec1e77c0 msgr2=0x7fd8ec0bfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f20e1640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8ec1e77c0 0x7fd8ec0bfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f20e1640 1 -- 172.21.15.77:0/2433691881 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec14a390 con 0x7fd8d80051d0 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f18e0640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd8ec1e77c0 0x7fd8ec0bfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:11.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f20e1640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8ec14e3b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800e3f0 tx=0x7fd8e800e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8e2ffd640 1 -- 172.21.15.77:0/2433691881 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8019070 con 0x7fd8d80051d0 2024-04-25T13:47:11.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8e2ffd640 1 -- 172.21.15.77:0/2433691881 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e80052e0 con 0x7fd8d80051d0 2024-04-25T13:47:11.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ec14a670 con 0x7fd8d80051d0 2024-04-25T13:47:11.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8e2ffd640 1 -- 172.21.15.77:0/2433691881 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8003820 con 0x7fd8d80051d0 2024-04-25T13:47:11.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ec14e8f0 con 0x7fd8d80051d0 2024-04-25T13:47:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8ec06a2f0 con 0x7fd8d80051d0 2024-04-25T13:47:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8e2ffd640 1 -- 172.21.15.77:0/2433691881 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd8e801c070 con 0x7fd8d80051d0 2024-04-25T13:47:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8e2ffd640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd8d006f430 0x7fd8d0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8f18e0640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd8d006f430 0x7fd8d0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.158+0000 7fd8e2ffd640 1 -- 172.21.15.77:0/2433691881 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fd8e808f2e0 con 0x7fd8d80051d0 2024-04-25T13:47:11.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.162+0000 7fd8e2ffd640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7fd8d0077860 0x7fd8d0079d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.162+0000 7fd8e2ffd640 1 -- 172.21.15.77:0/2433691881 --> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8e8008e50 con 0x7fd8d0077860 2024-04-25T13:47:11.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.162+0000 7fd8e2ffd640 1 -- 172.21.15.77:0/2433691881 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd8e808f770 con 0x7fd8d80051d0 2024-04-25T13:47:11.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.162+0000 7fd8f28e2640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7fd8d0077860 0x7fd8d0079d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.162+0000 7fd8f18e0640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd8d006f430 0x7fd8d0071940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec1d8ec0 tx=0x7fd8dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.162+0000 7fd8f28e2640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7fd8d0077860 0x7fd8d0079d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.162+0000 7fd8e2ffd640 1 -- 172.21.15.77:0/2433691881 <== osd.0 v2:172.21.15.77:6824/1056805701 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8e8008e50 con 0x7fd8d0077860 2024-04-25T13:47:11.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 --> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd8ec14b810 con 0x7fd8d0077860 2024-04-25T13:47:11.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8e2ffd640 1 -- 172.21.15.77:0/2433691881 <== osd.0 v2:172.21.15.77:6824/1056805701 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd8ec14b810 con 0x7fd8d0077860 2024-04-25T13:47:11.175 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T13:47:11.175 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:47:11.175 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T13:47:11.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7fd8d0077860 msgr2=0x7fd8d0079d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6824/1056805701,v1:172.21.15.77:6825/1056805701] conn(0x7fd8d0077860 0x7fd8d0079d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd8d006f430 msgr2=0x7fd8d0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd8d006f430 0x7fd8d0071940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec1d8ec0 tx=0x7fd8dc008040 comp rx=0 tx=0).stop 2024-04-25T13:47:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 msgr2=0x7fd8ec14e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 --2- 172.21.15.77:0/2433691881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d80051d0 0x7fd8ec14e3b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800e3f0 tx=0x7fd8e800e8b0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f28e2640 1 -- 172.21.15.77:0/2433691881 reap_dead start 2024-04-25T13:47:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 shutdown_connections 2024-04-25T13:47:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 >> 172.21.15.77:0/2433691881 conn(0x7fd8ec0c37a0 msgr2=0x7fd8ec147f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 shutdown_connections 2024-04-25T13:47:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.174+0000 7fd8f4345640 1 -- 172.21.15.77:0/2433691881 wait complete. 2024-04-25T13:47:11.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T13:47:11.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.334+0000 7fc34bd2a640 1 Processor -- start 2024-04-25T13:47:11.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.334+0000 7fc34bd2a640 1 -- start start 2024-04-25T13:47:11.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc34bd2a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc34414f840 0x7fc34414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc34bd2a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc344150ab0 0x7fc344150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc34bd2a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc344150320 con 0x7fc3440a7aa0 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc34bd2a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc344151400 con 0x7fc34414f840 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc34bd2a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc3440708d0 con 0x7fc344150ab0 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc3492c5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc34414f840 0x7fc34414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc3492c5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc34414f840 0x7fc34414fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60546/0 (socket says 172.21.15.77:60546) 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc3492c5640 1 -- 172.21.15.77:0/363389216 learned_addr learned my addr 172.21.15.77:0/363389216 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc34a2c7640 1 --2- 172.21.15.77:0/363389216 >> v2:172.21.15.96:3300/0 conn(0x7fc344150ab0 0x7fc344150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc3492c5640 1 -- 172.21.15.77:0/363389216 >> v2:172.21.15.96:3300/0 conn(0x7fc344150ab0 msgr2=0x7fc344150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc3492c5640 1 --2- 172.21.15.77:0/363389216 >> v2:172.21.15.96:3300/0 conn(0x7fc344150ab0 0x7fc344150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc3492c5640 1 -- 172.21.15.77:0/363389216 >> v1:172.21.15.96:6789/0 conn(0x7fc3440a7aa0 legacy=0x7fc34406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.338+0000 7fc3492c5640 1 -- 172.21.15.77:0/363389216 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440a45a0 con 0x7fc34414f840 2024-04-25T13:47:11.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc3492c5640 1 --2- 172.21.15.77:0/363389216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34414f840 0x7fc34414fc50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc3440707e0 tx=0x7fc33401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb094a6911eeafb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc348ac4640 1 -- 172.21.15.77:0/363389216 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3340b0070 con 0x7fc34414f840 2024-04-25T13:47:11.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc348ac4640 1 -- 172.21.15.77:0/363389216 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3340ab600 con 0x7fc34414f840 2024-04-25T13:47:11.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc348ac4640 1 -- 172.21.15.77:0/363389216 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3340ab9d0 con 0x7fc34414f840 2024-04-25T13:47:11.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 -- 172.21.15.77:0/363389216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34414f840 msgr2=0x7fc34414fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 --2- 172.21.15.77:0/363389216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34414f840 0x7fc34414fc50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc3440707e0 tx=0x7fc33401c490 comp rx=0 tx=0).stop 2024-04-25T13:47:11.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 -- 172.21.15.77:0/363389216 shutdown_connections 2024-04-25T13:47:11.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 --2- 172.21.15.77:0/363389216 >> v2:172.21.15.96:3300/0 conn(0x7fc344150ab0 0x7fc344150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 --2- 172.21.15.77:0/363389216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34414f840 0x7fc34414fc50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 -- 172.21.15.77:0/363389216 >> 172.21.15.77:0/363389216 conn(0x7fc3440c4ae0 msgr2=0x7fc3440c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:11.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 -- 172.21.15.77:0/363389216 shutdown_connections 2024-04-25T13:47:11.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 -- 172.21.15.77:0/363389216 wait complete. 2024-04-25T13:47:11.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 Processor -- start 2024-04-25T13:47:11.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.342+0000 7fc34bd2a640 1 -- start start 2024-04-25T13:47:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34bd2a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3440a7aa0 0x7fc34413f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34bd2a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34414f840 0x7fc34413ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34bd2a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc344150ab0 0x7fc3440a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34bd2a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440a9100 con 0x7fc344150ab0 2024-04-25T13:47:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34bd2a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440a8f80 con 0x7fc34414f840 2024-04-25T13:47:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34bd2a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc3440a9280 con 0x7fc3440a7aa0 2024-04-25T13:47:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34a2c7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc344150ab0 0x7fc3440a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34a2c7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc344150ab0 0x7fc3440a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60550/0 (socket says 172.21.15.77:60550) 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34a2c7640 1 -- 172.21.15.77:0/4042155218 learned_addr learned my addr 172.21.15.77:0/4042155218 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc3492c5640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34414f840 0x7fc34413ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc349ac6640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3440a7aa0 0x7fc34413f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34a2c7640 1 -- 172.21.15.77:0/4042155218 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3440a7aa0 msgr2=0x7fc34413f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34a2c7640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3440a7aa0 0x7fc34413f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34a2c7640 1 -- 172.21.15.77:0/4042155218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34414f840 msgr2=0x7fc34413ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34a2c7640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34414f840 0x7fc34413ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34a2c7640 1 -- 172.21.15.77:0/4042155218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440744a0 con 0x7fc344150ab0 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34a2c7640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc344150ab0 0x7fc3440a0b80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc33c007d70 tx=0x7fc33c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc33a7fc640 1 -- 172.21.15.77:0/4042155218 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c014420 con 0x7fc344150ab0 2024-04-25T13:47:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc33a7fc640 1 -- 172.21.15.77:0/4042155218 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c019070 con 0x7fc344150ab0 2024-04-25T13:47:11.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc344074740 con 0x7fc344150ab0 2024-04-25T13:47:11.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc33a7fc640 1 -- 172.21.15.77:0/4042155218 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c014820 con 0x7fc344150ab0 2024-04-25T13:47:11.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3440a1a90 con 0x7fc344150ab0 2024-04-25T13:47:11.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc34406a1a0 con 0x7fc344150ab0 2024-04-25T13:47:11.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc33a7fc640 1 -- 172.21.15.77:0/4042155218 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc33c0149c0 con 0x7fc344150ab0 2024-04-25T13:47:11.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.346+0000 7fc33a7fc640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc32806f430 0x7fc328071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.350+0000 7fc33a7fc640 1 -- 172.21.15.77:0/4042155218 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fc33c090920 con 0x7fc344150ab0 2024-04-25T13:47:11.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.350+0000 7fc349ac6640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc32806f430 0x7fc328071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.350+0000 7fc349ac6640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc32806f430 0x7fc328071940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3440a50e0 tx=0x7fc340009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.354+0000 7fc33a7fc640 1 -- 172.21.15.77:0/4042155218 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc33c05d8f0 con 0x7fc344150ab0 2024-04-25T13:47:11.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:11.391 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:11.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:11.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:11.399 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:11.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.514+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fc344073240 con 0x7fc32806f430 2024-04-25T13:47:11.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc33a7fc640 1 -- 172.21.15.77:0/4042155218 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc344073240 con 0x7fc32806f430 2024-04-25T13:47:11.517 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc32806f430 msgr2=0x7fc328071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc32806f430 0x7fc328071940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3440a50e0 tx=0x7fc340009040 comp rx=0 tx=0).stop 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc344150ab0 msgr2=0x7fc3440a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc344150ab0 0x7fc3440a0b80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc33c007d70 tx=0x7fc33c00e4b0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 shutdown_connections 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc32806f430 0x7fc328071940 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc344150ab0 0x7fc3440a0b80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34414f840 0x7fc34413ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 --2- 172.21.15.77:0/4042155218 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc3440a7aa0 0x7fc34413f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 >> 172.21.15.77:0/4042155218 conn(0x7fc3440c4ae0 msgr2=0x7fc3440a9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:11.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 shutdown_connections 2024-04-25T13:47:11.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.518+0000 7fc34bd2a640 1 -- 172.21.15.77:0/4042155218 wait complete. 2024-04-25T13:47:11.539 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T13:47:11.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:47:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f783b184640 1 Processor -- start 2024-04-25T13:47:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f783b184640 1 -- start start 2024-04-25T13:47:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f783b184640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783406f8f0 0x7f78340a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f783b184640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f783414ebf0 0x7f783414f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f783b184640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7834152830 con 0x7f78340732b0 2024-04-25T13:47:11.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f783b184640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f78340a8310 con 0x7f783414ebf0 2024-04-25T13:47:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f783b184640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f78340736c0 con 0x7f783406f8f0 2024-04-25T13:47:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7839721640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f783414ebf0 0x7f783414f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7838f20640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f78340732b0 0x7f78340a6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46608/0 (socket says 172.21.15.77:46608) 2024-04-25T13:47:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7839721640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f783414ebf0 0x7f783414f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60558/0 (socket says 172.21.15.77:60558) 2024-04-25T13:47:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7838f20640 1 -- 172.21.15.77:0/3387347277 learned_addr learned my addr 172.21.15.77:0/3387347277 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:11.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f78337fe640 1 -- 172.21.15.77:0/3387347277 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183119841 0 0) 0x7f7834152830 con 0x7f78340732b0 2024-04-25T13:47:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f78337fe640 1 -- 172.21.15.77:0/3387347277 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7824003450 con 0x7f78340732b0 2024-04-25T13:47:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7833fff640 1 --2- 172.21.15.77:0/3387347277 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783406f8f0 0x7f78340a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7839721640 1 -- 172.21.15.77:0/3387347277 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783406f8f0 msgr2=0x7f78340a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7839721640 1 --2- 172.21.15.77:0/3387347277 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783406f8f0 0x7f78340a6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7839721640 1 -- 172.21.15.77:0/3387347277 >> v1:172.21.15.77:6789/0 conn(0x7f78340732b0 legacy=0x7f78340a6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7839721640 1 -- 172.21.15.77:0/3387347277 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7834152ad0 con 0x7f783414ebf0 2024-04-25T13:47:11.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.698+0000 7f7833fff640 1 --2- 172.21.15.77:0/3387347277 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783406f8f0 0x7f78340a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:11.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f7839721640 1 --2- 172.21.15.77:0/3387347277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f783414ebf0 0x7f783414f000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f782c009d90 tx=0x7f782c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68f73dccdc4af66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f78337fe640 1 -- 172.21.15.77:0/3387347277 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c0b2070 con 0x7f783414ebf0 2024-04-25T13:47:11.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f78337fe640 1 -- 172.21.15.77:0/3387347277 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c0a5720 con 0x7f783414ebf0 2024-04-25T13:47:11.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f78337fe640 1 -- 172.21.15.77:0/3387347277 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c0a5af0 con 0x7f783414ebf0 2024-04-25T13:47:11.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 -- 172.21.15.77:0/3387347277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f783414ebf0 msgr2=0x7f783414f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 --2- 172.21.15.77:0/3387347277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f783414ebf0 0x7f783414f000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f782c009d90 tx=0x7f782c01c8e0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 -- 172.21.15.77:0/3387347277 shutdown_connections 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 --2- 172.21.15.77:0/3387347277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f783414ebf0 0x7f783414f000 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 --2- 172.21.15.77:0/3387347277 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783406f8f0 0x7f78340a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 -- 172.21.15.77:0/3387347277 >> 172.21.15.77:0/3387347277 conn(0x7f78340c37a0 msgr2=0x7f78340c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 -- 172.21.15.77:0/3387347277 shutdown_connections 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 -- 172.21.15.77:0/3387347277 wait complete. 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 Processor -- start 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.702+0000 7f783b184640 1 -- start start 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f783b184640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f783406f8f0 0x7f78341eb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f783b184640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78340732b0 0x7f78340c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f783b184640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783414ebf0 0x7f78341e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f783b184640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f783415b3d0 con 0x7f78340732b0 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f783b184640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f78340a75e0 con 0x7f783406f8f0 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f783b184640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f783415b550 con 0x7f783414ebf0 2024-04-25T13:47:11.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7833fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78340732b0 0x7f78340c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7833fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78340732b0 0x7f78340c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60560/0 (socket says 172.21.15.77:60560) 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7833fff640 1 -- 172.21.15.77:0/3295030860 learned_addr learned my addr 172.21.15.77:0/3295030860 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7839721640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783414ebf0 0x7f78341e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7833fff640 1 -- 172.21.15.77:0/3295030860 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783414ebf0 msgr2=0x7f78341e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7838f20640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f783406f8f0 0x7f78341eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7833fff640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f783414ebf0 0x7f78341e78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7833fff640 1 -- 172.21.15.77:0/3295030860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f783406f8f0 msgr2=0x7f78341eb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7833fff640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f783406f8f0 0x7f78341eb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7833fff640 1 -- 172.21.15.77:0/3295030860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78341491d0 con 0x7f78340732b0 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7838f20640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f783406f8f0 0x7f78341eb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f7833fff640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78340732b0 0x7f78340c2b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f782000c820 tx=0x7f782000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f78317fa640 1 -- 172.21.15.77:0/3295030860 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820015070 con 0x7f78340732b0 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f78317fa640 1 -- 172.21.15.77:0/3295030860 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78200079d0 con 0x7f78340732b0 2024-04-25T13:47:11.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7834148bb0 con 0x7f78340732b0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f78317fa640 1 -- 172.21.15.77:0/3295030860 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820007da0 con 0x7f78340732b0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7834149420 con 0x7f78340732b0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f783406a2f0 con 0x7f78340732b0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f78317fa640 1 -- 172.21.15.77:0/3295030860 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7820018070 con 0x7f78340732b0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.706+0000 7f78317fa640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f781806f400 0x7f7818071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.710+0000 7f78317fa640 1 -- 172.21.15.77:0/3295030860 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f782008f690 con 0x7f78340732b0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.710+0000 7f7838f20640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f781806f400 0x7f7818071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.710+0000 7f78317fa640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f7818077830 0x7f7818079d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.710+0000 7f78317fa640 1 -- 172.21.15.77:0/3295030860 --> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f781807a3f0 con 0x7f7818077830 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.710+0000 7f78317fa640 1 -- 172.21.15.77:0/3295030860 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f782008fb20 con 0x7f78340732b0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.710+0000 7f7839721640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f7818077830 0x7f7818079d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.710+0000 7f7838f20640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f781806f400 0x7f7818071910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7828005890 tx=0x7f7828009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.710+0000 7f7839721640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f7818077830 0x7f7818079d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.710+0000 7f78317fa640 1 -- 172.21.15.77:0/3295030860 <== osd.1 v2:172.21.15.77:6809/2369138658 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f781807a3f0 con 0x7f7818077830 2024-04-25T13:47:11.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 --> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f783414cda0 con 0x7f7818077830 2024-04-25T13:47:11.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f78317fa640 1 -- 172.21.15.77:0/3295030860 <== osd.1 v2:172.21.15.77:6809/2369138658 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f783414cda0 con 0x7f7818077830 2024-04-25T13:47:11.724 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T13:47:11.724 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:47:11.724 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f7818077830 msgr2=0x7f7818079d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6809/2369138658,v1:172.21.15.77:6811/2369138658] conn(0x7f7818077830 0x7f7818079d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f781806f400 msgr2=0x7f7818071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f781806f400 0x7f7818071910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7828005890 tx=0x7f7828009040 comp rx=0 tx=0).stop 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78340732b0 msgr2=0x7f78340c2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 --2- 172.21.15.77:0/3295030860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78340732b0 0x7f78340c2b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f782000c820 tx=0x7f782000cce0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f7839721640 1 -- 172.21.15.77:0/3295030860 reap_dead start 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 shutdown_connections 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 >> 172.21.15.77:0/3295030860 conn(0x7f78340c37a0 msgr2=0x7f78340727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.722+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 shutdown_connections 2024-04-25T13:47:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.726+0000 7f783b184640 1 -- 172.21.15.77:0/3295030860 wait complete. 2024-04-25T13:47:11.743 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T13:47:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e934b3640 1 Processor -- start 2024-04-25T13:47:11.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e934b3640 1 -- start start 2024-04-25T13:47:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e934b3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7e8c152650 0x7f7e8c14bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e934b3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e8c156740 con 0x7f7e8c0b9050 2024-04-25T13:47:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e934b3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e8c0744e0 con 0x7f7e8c152240 2024-04-25T13:47:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e934b3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7e8c155ba0 con 0x7f7e8c152650 2024-04-25T13:47:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e9124f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7e8c0b9050 0x7f7e8c070250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46610/0 (socket says 172.21.15.77:46610) 2024-04-25T13:47:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e9124f640 1 -- 172.21.15.77:0/957617942 learned_addr learned my addr 172.21.15.77:0/957617942 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e91a50640 1 --2- 172.21.15.77:0/957617942 >> v2:172.21.15.96:3300/0 conn(0x7f7e8c152650 0x7f7e8c14bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 317348560 0 0) 0x7f7e8c156740 con 0x7f7e8c0b9050 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e74003530 con 0x7f7e8c0b9050 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1752469615 0 0) 0x7f7e74003530 con 0x7f7e8c0b9050 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 >> v2:172.21.15.96:3300/0 conn(0x7f7e8c152650 msgr2=0x7f7e8c14bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 --2- 172.21.15.77:0/957617942 >> v2:172.21.15.96:3300/0 conn(0x7f7e8c152650 0x7f7e8c14bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 >> v1:172.21.15.96:6789/0 conn(0x7f7e8c152240 legacy=0x7f7e8c156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c155830 con 0x7f7e8c0b9050 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f7e84001a00 con 0x7f7e8c0b9050 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 >> v1:172.21.15.77:6789/0 conn(0x7f7e8c0b9050 legacy=0x7f7e8c070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74003a30 0x7f7e74003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e74004810 0x7f7e74004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.894+0000 7f7e8bfff640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e74005360 0x7f7e7400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c155ba0 con 0x7f7e74005360 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7400c260 con 0x7f7e74004810 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7400c460 con 0x7f7e74003a30 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e91a50640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e74005360 0x7f7e7400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e90a4e640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e74004810 0x7f7e74004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e9124f640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74003a30 0x7f7e74003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e91a50640 1 -- 172.21.15.77:0/957617942 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74003a30 msgr2=0x7f7e74003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e91a50640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74003a30 0x7f7e74003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e91a50640 1 -- 172.21.15.77:0/957617942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e74004810 msgr2=0x7f7e74004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e91a50640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e74004810 0x7f7e74004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e91a50640 1 -- 172.21.15.77:0/957617942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e74003530 con 0x7f7e74005360 2024-04-25T13:47:11.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e91a50640 1 -- 172.21.15.77:0/957617942 reap_dead start 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e91a50640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e74005360 0x7f7e7400b9d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009ae0 tx=0x7f7e7c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469fbc70a79b590f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0096b0 con 0x7f7e74005360 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c004020 con 0x7f7e74005360 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e8bfff640 1 -- 172.21.15.77:0/957617942 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c004410 con 0x7f7e74005360 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e934b3640 1 -- 172.21.15.77:0/957617942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e74005360 msgr2=0x7f7e7400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e934b3640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e74005360 0x7f7e7400b9d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009ae0 tx=0x7f7e7c01cab0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e934b3640 1 -- 172.21.15.77:0/957617942 shutdown_connections 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e934b3640 1 --2- 172.21.15.77:0/957617942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e74005360 0x7f7e7400b9d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e934b3640 1 -- 172.21.15.77:0/957617942 >> 172.21.15.77:0/957617942 conn(0x7f7e8c06f560 msgr2=0x7f7e8c06f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e934b3640 1 -- 172.21.15.77:0/957617942 shutdown_connections 2024-04-25T13:47:11.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.898+0000 7f7e934b3640 1 -- 172.21.15.77:0/957617942 wait complete. 2024-04-25T13:47:11.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 Processor -- start 2024-04-25T13:47:11.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 -- start start 2024-04-25T13:47:11.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74005360 0x7f7e8c09c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e8c09dfe0 0x7f7e8c1e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e8c09e3f0 0x7f7e8c14cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c1561b0 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c156030 con 0x7f7e8c09dfe0 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c156330 con 0x7f7e74005360 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e91a50640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e8c09e3f0 0x7f7e8c14cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e91a50640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e8c09e3f0 0x7f7e8c14cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60578/0 (socket says 172.21.15.77:60578) 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e91a50640 1 -- 172.21.15.77:0/629204331 learned_addr learned my addr 172.21.15.77:0/629204331 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e9124f640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74005360 0x7f7e8c09c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e90a4e640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e8c09dfe0 0x7f7e8c1e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e91a50640 1 -- 172.21.15.77:0/629204331 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74005360 msgr2=0x7f7e8c09c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e91a50640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74005360 0x7f7e8c09c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e91a50640 1 -- 172.21.15.77:0/629204331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e8c09dfe0 msgr2=0x7f7e8c1e8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e91a50640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e8c09dfe0 0x7f7e8c1e8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e91a50640 1 -- 172.21.15.77:0/629204331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c14da80 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e9124f640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74005360 0x7f7e8c09c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e91a50640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e8c09e3f0 0x7f7e8c14cb80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c01d350 tx=0x7f7e7c019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e89ffb640 1 -- 172.21.15.77:0/629204331 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c003a30 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e89ffb640 1 -- 172.21.15.77:0/629204331 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c0ba070 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c09cc20 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e89ffb640 1 -- 172.21.15.77:0/629204331 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c003df0 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.902+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c09d1e0 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.906+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c06a1a0 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.906+0000 7f7e89ffb640 1 -- 172.21.15.77:0/629204331 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7e7c0a5590 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.906+0000 7f7e89ffb640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7e7806f430 0x7f7e78071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.906+0000 7f7e9124f640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7e7806f430 0x7f7e78071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.906+0000 7f7e89ffb640 1 -- 172.21.15.77:0/629204331 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f7e7c129130 con 0x7f7e8c09e3f0 2024-04-25T13:47:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.906+0000 7f7e9124f640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7e7806f430 0x7f7e78071940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7e84000f90 tx=0x7f7e84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:11.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:11.910+0000 7f7e89ffb640 1 -- 172.21.15.77:0/629204331 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7e7c0c3020 con 0x7f7e8c09e3f0 2024-04-25T13:47:12.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.070+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f7e8c09c9f0 con 0x7f7e7806f430 2024-04-25T13:47:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.070+0000 7f7e89ffb640 1 -- 172.21.15.77:0/629204331 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7e8c09c9f0 con 0x7f7e7806f430 2024-04-25T13:47:12.073 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T13:47:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7e7806f430 msgr2=0x7f7e78071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7e7806f430 0x7f7e78071940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7e84000f90 tx=0x7f7e84009040 comp rx=0 tx=0).stop 2024-04-25T13:47:12.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e8c09e3f0 msgr2=0x7f7e8c14cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e8c09e3f0 0x7f7e8c14cb80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c01d350 tx=0x7f7e7c019850 comp rx=0 tx=0).stop 2024-04-25T13:47:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 shutdown_connections 2024-04-25T13:47:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f7e7806f430 0x7f7e78071940 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e8c09e3f0 0x7f7e8c14cb80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e8c09dfe0 0x7f7e8c1e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 --2- 172.21.15.77:0/629204331 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74005360 0x7f7e8c09c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 >> 172.21.15.77:0/629204331 conn(0x7f7e8c06f560 msgr2=0x7f7e8c0756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 shutdown_connections 2024-04-25T13:47:12.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.074+0000 7f7e934b3640 1 -- 172.21.15.77:0/629204331 wait complete. 2024-04-25T13:47:12.094 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T13:47:12.094 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:47:12.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe29b33c640 1 Processor -- start 2024-04-25T13:47:12.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe29b33c640 1 -- start start 2024-04-25T13:47:12.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe29b33c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2940baa20 0x7fe2941558f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe29b33c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe294070730 0x7fe294151a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe29b33c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2940b9130 con 0x7fe294151f40 2024-04-25T13:47:12.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe29b33c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe294072ba0 con 0x7fe2940baa20 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe29b33c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe2940bae30 con 0x7fe294070730 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe2990d8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2940baa20 0x7fe2941558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe2998d9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe294151f40 0x7fe294073be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46616/0 (socket says 172.21.15.77:46616) 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe2998d9640 1 -- 172.21.15.77:0/2169677464 learned_addr learned my addr 172.21.15.77:0/2169677464 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe2988d7640 1 --2- 172.21.15.77:0/2169677464 >> v2:172.21.15.96:3300/0 conn(0x7fe294070730 0x7fe294151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe2990d8640 1 -- 172.21.15.77:0/2169677464 >> v2:172.21.15.96:3300/0 conn(0x7fe294070730 msgr2=0x7fe294151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe2990d8640 1 --2- 172.21.15.77:0/2169677464 >> v2:172.21.15.96:3300/0 conn(0x7fe294070730 0x7fe294151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe2990d8640 1 -- 172.21.15.77:0/2169677464 >> v1:172.21.15.77:6789/0 conn(0x7fe294151f40 legacy=0x7fe294073be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe2990d8640 1 -- 172.21.15.77:0/2169677464 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2940b93d0 con 0x7fe2940baa20 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe28bfff640 1 -- 172.21.15.77:0/2169677464 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970738878 0 0) 0x7fe2940b9130 con 0x7fe294151f40 2024-04-25T13:47:12.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.246+0000 7fe2988d7640 1 --2- 172.21.15.77:0/2169677464 >> v2:172.21.15.96:3300/0 conn(0x7fe294070730 0x7fe294151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:12.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe2990d8640 1 --2- 172.21.15.77:0/2169677464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 0x7fe2941558f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe294068d30 tx=0x7fe28c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c67e572c07bf7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe28bfff640 1 -- 172.21.15.77:0/2169677464 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b0070 con 0x7fe2940baa20 2024-04-25T13:47:12.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe28bfff640 1 -- 172.21.15.77:0/2169677464 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28c0ab600 con 0x7fe2940baa20 2024-04-25T13:47:12.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe28bfff640 1 -- 172.21.15.77:0/2169677464 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0ab9d0 con 0x7fe2940baa20 2024-04-25T13:47:12.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe29b33c640 1 -- 172.21.15.77:0/2169677464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 msgr2=0x7fe2941558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe29b33c640 1 --2- 172.21.15.77:0/2169677464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 0x7fe2941558f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe294068d30 tx=0x7fe28c01c460 comp rx=0 tx=0).stop 2024-04-25T13:47:12.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe29b33c640 1 -- 172.21.15.77:0/2169677464 shutdown_connections 2024-04-25T13:47:12.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe29b33c640 1 --2- 172.21.15.77:0/2169677464 >> v2:172.21.15.96:3300/0 conn(0x7fe294070730 0x7fe294151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe29b33c640 1 --2- 172.21.15.77:0/2169677464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 0x7fe2941558f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe29b33c640 1 -- 172.21.15.77:0/2169677464 >> 172.21.15.77:0/2169677464 conn(0x7fe29406c9b0 msgr2=0x7fe29406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:12.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe29b33c640 1 -- 172.21.15.77:0/2169677464 shutdown_connections 2024-04-25T13:47:12.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.250+0000 7fe29b33c640 1 -- 172.21.15.77:0/2169677464 wait complete. 2024-04-25T13:47:12.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 Processor -- start 2024-04-25T13:47:12.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 -- start start 2024-04-25T13:47:12.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294070730 0x7fe294143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 0x7fe294153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe294151f40 0x7fe294148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe29415f690 con 0x7fe2940baa20 2024-04-25T13:47:12.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe29415f810 con 0x7fe294070730 2024-04-25T13:47:12.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe29415f990 con 0x7fe294151f40 2024-04-25T13:47:12.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2988d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 0x7fe294153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2988d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 0x7fe294153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60598/0 (socket says 172.21.15.77:60598) 2024-04-25T13:47:12.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2988d7640 1 -- 172.21.15.77:0/3578884795 learned_addr learned my addr 172.21.15.77:0/3578884795 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2998d9640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe294151f40 0x7fe294148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2990d8640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294070730 0x7fe294143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2988d7640 1 -- 172.21.15.77:0/3578884795 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe294151f40 msgr2=0x7fe294148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2988d7640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe294151f40 0x7fe294148790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2988d7640 1 -- 172.21.15.77:0/3578884795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294070730 msgr2=0x7fe294143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2988d7640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294070730 0x7fe294143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2988d7640 1 -- 172.21.15.77:0/3578884795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29414e080 con 0x7fe2940baa20 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe2988d7640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 0x7fe294153f60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c820 tx=0x7fe28400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe289ffb640 1 -- 172.21.15.77:0/3578884795 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284015070 con 0x7fe2940baa20 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe289ffb640 1 -- 172.21.15.77:0/3578884795 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe284007a30 con 0x7fe2940baa20 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe289ffb640 1 -- 172.21.15.77:0/3578884795 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284007e00 con 0x7fe2940baa20 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2941eeae0 con 0x7fe2940baa20 2024-04-25T13:47:12.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.254+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2941544a0 con 0x7fe2940baa20 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe294153b40 con 0x7fe2940baa20 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe289ffb640 1 -- 172.21.15.77:0/3578884795 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe284018070 con 0x7fe2940baa20 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe289ffb640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe27806f430 0x7fe278071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe289ffb640 1 -- 172.21.15.77:0/3578884795 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe28408f8c0 con 0x7fe2940baa20 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe2990d8640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe27806f430 0x7fe278071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe289ffb640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7fe278077860 0x7fe278079d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe289ffb640 1 -- 172.21.15.77:0/3578884795 --> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe27807a420 con 0x7fe278077860 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe289ffb640 1 -- 172.21.15.77:0/3578884795 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe28408fd50 con 0x7fe2940baa20 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe2998d9640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7fe278077860 0x7fe278079d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe2990d8640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe27806f430 0x7fe278071940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0ad000 tx=0x7fe28c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe2998d9640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7fe278077860 0x7fe278079d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.258+0000 7fe289ffb640 1 -- 172.21.15.77:0/3578884795 <== osd.2 v2:172.21.15.77:6800/4192345588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe27807a420 con 0x7fe278077860 2024-04-25T13:47:12.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 --> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe29406a2f0 con 0x7fe278077860 2024-04-25T13:47:12.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe289ffb640 1 -- 172.21.15.77:0/3578884795 <== osd.2 v2:172.21.15.77:6800/4192345588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe29406a2f0 con 0x7fe278077860 2024-04-25T13:47:12.274 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T13:47:12.274 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:47:12.274 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T13:47:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7fe278077860 msgr2=0x7fe278079d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6800/4192345588,v1:172.21.15.77:6801/4192345588] conn(0x7fe278077860 0x7fe278079d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe27806f430 msgr2=0x7fe278071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe27806f430 0x7fe278071940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0ad000 tx=0x7fe28c0a6000 comp rx=0 tx=0).stop 2024-04-25T13:47:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 msgr2=0x7fe294153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 --2- 172.21.15.77:0/3578884795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2940baa20 0x7fe294153f60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c820 tx=0x7fe28400cce0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe2998d9640 1 -- 172.21.15.77:0/3578884795 reap_dead start 2024-04-25T13:47:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 shutdown_connections 2024-04-25T13:47:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 >> 172.21.15.77:0/3578884795 conn(0x7fe29406c9b0 msgr2=0x7fe2940c1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 shutdown_connections 2024-04-25T13:47:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.274+0000 7fe29b33c640 1 -- 172.21.15.77:0/3578884795 wait complete. 2024-04-25T13:47:12.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T13:47:12.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.438+0000 7f1fb5e5b640 1 Processor -- start 2024-04-25T13:47:12.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.438+0000 7f1fb5e5b640 1 -- start start 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.438+0000 7f1fb5e5b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb00b90e0 0x7f1fb00bb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.438+0000 7f1fb5e5b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb0153010 con 0x7f1fb0068760 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.438+0000 7f1fb5e5b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb01532b0 con 0x7f1fb014ed90 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.438+0000 7f1fb5e5b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb0068b70 con 0x7f1fb00b90e0 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.438+0000 7f1faeffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1fb0068760 0x7f1fb014e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46618/0 (socket says 172.21.15.77:46618) 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.438+0000 7f1faeffd640 1 -- 172.21.15.77:0/2764288031 learned_addr learned my addr 172.21.15.77:0/2764288031 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.438+0000 7f1faf7fe640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb00b90e0 0x7f1fb00bb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240121119 0 0) 0x7f1fb0153010 con 0x7f1fb0068760 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f98003530 con 0x7f1fb0068760 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 979768565 0 0) 0x7f1f98003530 con 0x7f1fb0068760 2024-04-25T13:47:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb00b90e0 msgr2=0x7f1fb00bb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb00b90e0 0x7f1fb00bb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 >> v1:172.21.15.96:6789/0 conn(0x7f1fb014ed90 legacy=0x7f1fb014f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb0068cf0 con 0x7f1fb0068760 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f1fa40016a0 con 0x7f1fb0068760 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 >> v1:172.21.15.77:6789/0 conn(0x7f1fb0068760 legacy=0x7f1fb014e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb00b90e0 0x7f1f98003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98003fe0 0x7f1f98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f98004d50 0x7f1f980051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb0068b70 con 0x7f1f98004d50 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9800bc80 con 0x7f1f98003fe0 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9800be80 con 0x7f1fb00b90e0 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1faffff640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f98004d50 0x7f1f980051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1faeffd640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98003fe0 0x7f1f98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1faf7fe640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb00b90e0 0x7f1f98003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1faffff640 1 -- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb00b90e0 msgr2=0x7f1f98003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1faffff640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb00b90e0 0x7f1f98003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1faffff640 1 -- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98003fe0 msgr2=0x7f1f98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1faffff640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98003fe0 0x7f1f98004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1faffff640 1 -- 172.21.15.77:0/2764288031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f98003530 con 0x7f1f98004d50 2024-04-25T13:47:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1faffff640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f98004d50 0x7f1f980051e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8001e70 tx=0x7f1fa801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539f2aba9ee2f16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.442+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8001a90 con 0x7f1f98004d50 2024-04-25T13:47:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa8003b80 con 0x7f1f98004d50 2024-04-25T13:47:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fae7fc640 1 -- 172.21.15.77:0/2764288031 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8005080 con 0x7f1f98004d50 2024-04-25T13:47:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2764288031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f98004d50 msgr2=0x7f1f980051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 --2- 172.21.15.77:0/2764288031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f98004d50 0x7f1f980051e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8001e70 tx=0x7f1fa801c780 comp rx=0 tx=0).stop 2024-04-25T13:47:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1faffff640 1 -- 172.21.15.77:0/2764288031 reap_dead start 2024-04-25T13:47:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2764288031 shutdown_connections 2024-04-25T13:47:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2764288031 >> 172.21.15.77:0/2764288031 conn(0x7f1fb006d5d0 msgr2=0x7f1fb006f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2764288031 shutdown_connections 2024-04-25T13:47:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2764288031 wait complete. 2024-04-25T13:47:12.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 Processor -- start 2024-04-25T13:47:12.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 -- start start 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb0146490 0x7f1fb01ec010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb0152030 0x7f1fb0148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb01490f0 0x7f1fb0072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb00bb210 con 0x7f1fb0152030 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb0150160 con 0x7f1fb01490f0 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.446+0000 7f1fb5e5b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb00bb390 con 0x7f1fb0146490 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb0152030 0x7f1fb0148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb0152030 0x7f1fb0148bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60626/0 (socket says 172.21.15.77:60626) 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faeffd640 1 -- 172.21.15.77:0/2130240329 learned_addr learned my addr 172.21.15.77:0/2130240329 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faf7fe640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb0146490 0x7f1fb01ec010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faffff640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb01490f0 0x7f1fb0072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faeffd640 1 -- 172.21.15.77:0/2130240329 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb0146490 msgr2=0x7f1fb01ec010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faeffd640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb0146490 0x7f1fb01ec010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faeffd640 1 -- 172.21.15.77:0/2130240329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb01490f0 msgr2=0x7f1fb0072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faeffd640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb01490f0 0x7f1fb0072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faeffd640 1 -- 172.21.15.77:0/2130240329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb01468a0 con 0x7f1fb0152030 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faf7fe640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb0146490 0x7f1fb01ec010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faeffd640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb0152030 0x7f1fb0148bb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1fb006df10 tx=0x7f1fa4011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1f97fff640 1 -- 172.21.15.77:0/2130240329 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4010040 con 0x7f1fb0152030 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1f97fff640 1 -- 172.21.15.77:0/2130240329 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa401a070 con 0x7f1fb0152030 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb01d9250 con 0x7f1fb0152030 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1f97fff640 1 -- 172.21.15.77:0/2130240329 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400fcd0 con 0x7f1fb0152030 2024-04-25T13:47:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb01d94f0 con 0x7f1fb0152030 2024-04-25T13:47:12.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb006a1a0 con 0x7f1fb0152030 2024-04-25T13:47:12.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1f97fff640 1 -- 172.21.15.77:0/2130240329 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1fa401f460 con 0x7f1fb0152030 2024-04-25T13:47:12.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1f97fff640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1f9c06f400 0x7f1f9c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1f97fff640 1 -- 172.21.15.77:0/2130240329 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f1fa40924f0 con 0x7f1fb0152030 2024-04-25T13:47:12.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faf7fe640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1f9c06f400 0x7f1f9c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.450+0000 7f1faf7fe640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1f9c06f400 0x7f1f9c071910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fb01528d0 tx=0x7f1fa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.458+0000 7f1f97fff640 1 -- 172.21.15.77:0/2130240329 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1fa405f350 con 0x7f1fb0152030 2024-04-25T13:47:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.618+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f1fb0069cd0 con 0x7f1f9c06f400 2024-04-25T13:47:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.618+0000 7f1f97fff640 1 -- 172.21.15.77:0/2130240329 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1fb0069cd0 con 0x7f1f9c06f400 2024-04-25T13:47:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T13:47:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1f9c06f400 msgr2=0x7f1f9c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1f9c06f400 0x7f1f9c071910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fb01528d0 tx=0x7f1fa0008040 comp rx=0 tx=0).stop 2024-04-25T13:47:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb0152030 msgr2=0x7f1fb0148bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb0152030 0x7f1fb0148bb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1fb006df10 tx=0x7f1fa4011c20 comp rx=0 tx=0).stop 2024-04-25T13:47:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 shutdown_connections 2024-04-25T13:47:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f1f9c06f400 0x7f1f9c071910 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fb01490f0 0x7f1fb0072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb0152030 0x7f1fb0148bb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 --2- 172.21.15.77:0/2130240329 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1fb0146490 0x7f1fb01ec010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 >> 172.21.15.77:0/2130240329 conn(0x7f1fb006d5d0 msgr2=0x7f1fb0070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:12.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 shutdown_connections 2024-04-25T13:47:12.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.622+0000 7f1fb5e5b640 1 -- 172.21.15.77:0/2130240329 wait complete. 2024-04-25T13:47:12.640 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T13:47:12.640 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:47:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd67a47a640 1 Processor -- start 2024-04-25T13:47:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd67a47a640 1 -- start start 2024-04-25T13:47:12.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd67a47a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd674073d70 0x7fd67406f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd67a47a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd674150120 con 0x7fd67414f600 2024-04-25T13:47:12.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd67a47a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6740a6b70 con 0x7fd6741505e0 2024-04-25T13:47:12.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd67a47a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd6740a75f0 con 0x7fd674073d70 2024-04-25T13:47:12.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd6737fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd67414f600 0x7fd67414fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46620/0 (socket says 172.21.15.77:46620) 2024-04-25T13:47:12.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd6737fe640 1 -- 172.21.15.77:0/703193829 learned_addr learned my addr 172.21.15.77:0/703193829 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:12.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477070511 0 0) 0x7fd668001120 con 0x7fd67414f600 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd65c003530 con 0x7fd67414f600 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd673fff640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd674073d70 0x7fd67406f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2238867615 0 0) 0x7fd65c003530 con 0x7fd67414f600 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd674073d70 msgr2=0x7fd67406f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd674073d70 0x7fd67406f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 >> v1:172.21.15.96:6789/0 conn(0x7fd6741505e0 legacy=0x7fd6741509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6740a6e50 con 0x7fd67414f600 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fd668001850 con 0x7fd67414f600 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 >> v1:172.21.15.77:6789/0 conn(0x7fd67414f600 legacy=0x7fd67414fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c0039f0 0x7fd65c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c004810 0x7fd65c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd674073d70 0x7fd65c0052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c00bb80 con 0x7fd65c004810 2024-04-25T13:47:12.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c00bd30 con 0x7fd65c0039f0 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd65c00bf30 con 0x7fd674073d70 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd6737fe640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c004810 0x7fd65c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd678a17640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd674073d70 0x7fd65c0052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.782+0000 7fd673fff640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c0039f0 0x7fd65c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd6737fe640 1 -- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd674073d70 msgr2=0x7fd65c0052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd6737fe640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd674073d70 0x7fd65c0052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd6737fe640 1 -- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c0039f0 msgr2=0x7fd65c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd6737fe640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c0039f0 0x7fd65c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd6737fe640 1 -- 172.21.15.77:0/703193829 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c003530 con 0x7fd65c004810 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd678a17640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd674073d70 0x7fd65c0052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd673fff640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c0039f0 0x7fd65c003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd6737fe640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c004810 0x7fd65c004c20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd6740b8e10 tx=0x7fd66801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf63081a3ffffbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66800c0e0 con 0x7fd65c004810 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd668005b00 con 0x7fd65c004810 2024-04-25T13:47:12.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd672ffd640 1 -- 172.21.15.77:0/703193829 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668007070 con 0x7fd65c004810 2024-04-25T13:47:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd67a47a640 1 -- 172.21.15.77:0/703193829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c004810 msgr2=0x7fd65c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd67a47a640 1 --2- 172.21.15.77:0/703193829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c004810 0x7fd65c004c20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd6740b8e10 tx=0x7fd66801f370 comp rx=0 tx=0).stop 2024-04-25T13:47:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd678a17640 1 -- 172.21.15.77:0/703193829 reap_dead start 2024-04-25T13:47:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd67a47a640 1 -- 172.21.15.77:0/703193829 shutdown_connections 2024-04-25T13:47:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd67a47a640 1 -- 172.21.15.77:0/703193829 >> 172.21.15.77:0/703193829 conn(0x7fd6740c37a0 msgr2=0x7fd6740c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd67a47a640 1 -- 172.21.15.77:0/703193829 shutdown_connections 2024-04-25T13:47:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.786+0000 7fd67a47a640 1 -- 172.21.15.77:0/703193829 wait complete. 2024-04-25T13:47:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 Processor -- start 2024-04-25T13:47:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 -- start start 2024-04-25T13:47:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd65c004810 0x7fd674147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6741478b0 0x7fd6741d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6741d8c30 0x7fd6741dac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd674151280 con 0x7fd6741d8c30 2024-04-25T13:47:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd674151100 con 0x7fd6741478b0 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd674151400 con 0x7fd65c004810 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd678a17640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6741d8c30 0x7fd6741dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd678a17640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6741d8c30 0x7fd6741dac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60646/0 (socket says 172.21.15.77:60646) 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd678a17640 1 -- 172.21.15.77:0/2466663274 learned_addr learned my addr 172.21.15.77:0/2466663274 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd6737fe640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6741478b0 0x7fd6741d86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd673fff640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd65c004810 0x7fd674147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd678a17640 1 -- 172.21.15.77:0/2466663274 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd65c004810 msgr2=0x7fd674147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd678a17640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd65c004810 0x7fd674147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd678a17640 1 -- 172.21.15.77:0/2466663274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6741478b0 msgr2=0x7fd6741d86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd678a17640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6741478b0 0x7fd6741d86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd678a17640 1 -- 172.21.15.77:0/2466663274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6740c0810 con 0x7fd6741d8c30 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd6737fe640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6741478b0 0x7fd6741d86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd678a17640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6741d8c30 0x7fd6741dac50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd65c004790 tx=0x7fd66c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd670ff9640 1 -- 172.21.15.77:0/2466663274 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c006b60 con 0x7fd6741d8c30 2024-04-25T13:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd670ff9640 1 -- 172.21.15.77:0/2466663274 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66c006d00 con 0x7fd6741d8c30 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6741480e0 con 0x7fd6741d8c30 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd670ff9640 1 -- 172.21.15.77:0/2466663274 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c003bc0 con 0x7fd6741d8c30 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6740ba8d0 con 0x7fd6741d8c30 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.790+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd67406a2f0 con 0x7fd6741d8c30 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd670ff9640 1 -- 172.21.15.77:0/2466663274 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd66c01a020 con 0x7fd6741d8c30 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd670ff9640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd66006f430 0x7fd660071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd673fff640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd66006f430 0x7fd660071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd670ff9640 1 -- 172.21.15.77:0/2466663274 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fd66c08f390 con 0x7fd6741d8c30 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd670ff9640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fd660077860 0x7fd660079d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd670ff9640 1 -- 172.21.15.77:0/2466663274 --> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd66c004e50 con 0x7fd660077860 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd670ff9640 1 -- 172.21.15.77:0/2466663274 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd66c08f820 con 0x7fd6741d8c30 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd6737fe640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fd660077860 0x7fd660079d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd673fff640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd66006f430 0x7fd660071940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd6640098a0 tx=0x7fd664008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd6737fe640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fd660077860 0x7fd660079d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.794+0000 7fd670ff9640 1 -- 172.21.15.77:0/2466663274 <== osd.3 v2:172.21.15.77:6808/3215381613 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd66c004e50 con 0x7fd660077860 2024-04-25T13:47:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 --> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd674076210 con 0x7fd660077860 2024-04-25T13:47:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd670ff9640 1 -- 172.21.15.77:0/2466663274 <== osd.3 v2:172.21.15.77:6808/3215381613 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd674076210 con 0x7fd660077860 2024-04-25T13:47:12.807 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T13:47:12.807 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:47:12.807 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T13:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fd660077860 msgr2=0x7fd660079d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6808/3215381613,v1:172.21.15.77:6810/3215381613] conn(0x7fd660077860 0x7fd660079d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd66006f430 msgr2=0x7fd660071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd66006f430 0x7fd660071940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd6640098a0 tx=0x7fd664008040 comp rx=0 tx=0).stop 2024-04-25T13:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6741d8c30 msgr2=0x7fd6741dac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 --2- 172.21.15.77:0/2466663274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6741d8c30 0x7fd6741dac50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd65c004790 tx=0x7fd66c00dc00 comp rx=0 tx=0).stop 2024-04-25T13:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd678a17640 1 -- 172.21.15.77:0/2466663274 reap_dead start 2024-04-25T13:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 shutdown_connections 2024-04-25T13:47:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 >> 172.21.15.77:0/2466663274 conn(0x7fd6740c37a0 msgr2=0x7fd67406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 shutdown_connections 2024-04-25T13:47:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.806+0000 7fd67a47a640 1 -- 172.21.15.77:0/2466663274 wait complete. 2024-04-25T13:47:12.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T13:47:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.962+0000 7f420d1a4640 1 Processor -- start 2024-04-25T13:47:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.962+0000 7f420d1a4640 1 -- start start 2024-04-25T13:47:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.962+0000 7f420d1a4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f42080a6870 0x7f42080a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.962+0000 7f420d1a4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42080a71c0 con 0x7f42080c1ee0 2024-04-25T13:47:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.962+0000 7f420d1a4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42081529a0 con 0x7f42080c69b0 2024-04-25T13:47:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.962+0000 7f420d1a4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4208153480 con 0x7f42080a6870 2024-04-25T13:47:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f420759e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f42080c1ee0 0x7f42080c22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46624/0 (socket says 172.21.15.77:46624) 2024-04-25T13:47:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f420759e640 1 -- 172.21.15.77:0/1567442513 learned_addr learned my addr 172.21.15.77:0/1567442513 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f420659c640 1 --2- 172.21.15.77:0/1567442513 >> v2:172.21.15.96:3300/0 conn(0x7f42080a6870 0x7f42080a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260361217 0 0) 0x7f42080a71c0 con 0x7f42080c1ee0 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f0003530 con 0x7f42080c1ee0 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2639731433 0 0) 0x7f41f0003530 con 0x7f42080c1ee0 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 >> v2:172.21.15.96:3300/0 conn(0x7f42080a6870 msgr2=0x7f42080a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 --2- 172.21.15.77:0/1567442513 >> v2:172.21.15.96:3300/0 conn(0x7f42080a6870 0x7f42080a6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 >> v1:172.21.15.96:6789/0 conn(0x7f42080c69b0 legacy=0x7f420806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4208152c80 con 0x7f42080c1ee0 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f4200001a00 con 0x7f42080c1ee0 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 >> v1:172.21.15.77:6789/0 conn(0x7f42080c1ee0 legacy=0x7f42080c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0003a30 0x7f41f0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41f0004810 0x7f41f0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f0005360 0x7f41f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4208153480 con 0x7f41f0003a30 2024-04-25T13:47:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f41f000c260 con 0x7f41f0005360 2024-04-25T13:47:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f41f000c460 con 0x7f41f0004810 2024-04-25T13:47:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4206d9d640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0003a30 0x7f41f0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4206d9d640 1 -- 172.21.15.77:0/1567442513 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41f0004810 msgr2=0x7f41f0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f420759e640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f0005360 0x7f41f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4206d9d640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41f0004810 0x7f41f0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4206d9d640 1 -- 172.21.15.77:0/1567442513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f0005360 msgr2=0x7f41f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4206d9d640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f0005360 0x7f41f000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f420759e640 1 -- 172.21.15.77:0/1567442513 reap_dead start 2024-04-25T13:47:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4206d9d640 1 -- 172.21.15.77:0/1567442513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f0003530 con 0x7f41f0003a30 2024-04-25T13:47:12.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4206d9d640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0003a30 0x7f41f0003ea0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41f8001780 tx=0x7f41f801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b953ea7383ea41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f80013a0 con 0x7f41f0003a30 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f80052f0 con 0x7f41f0003a30 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.966+0000 7f4205d9b640 1 -- 172.21.15.77:0/1567442513 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f8003840 con 0x7f41f0003a30 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 -- 172.21.15.77:0/1567442513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0003a30 msgr2=0x7f41f0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0003a30 0x7f41f0003ea0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41f8001780 tx=0x7f41f801c3d0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 -- 172.21.15.77:0/1567442513 shutdown_connections 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 --2- 172.21.15.77:0/1567442513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0003a30 0x7f41f0003ea0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 -- 172.21.15.77:0/1567442513 >> 172.21.15.77:0/1567442513 conn(0x7f42080c7890 msgr2=0x7f42080c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 -- 172.21.15.77:0/1567442513 shutdown_connections 2024-04-25T13:47:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 -- 172.21.15.77:0/1567442513 wait complete. 2024-04-25T13:47:12.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 Processor -- start 2024-04-25T13:47:12.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 -- start start 2024-04-25T13:47:12.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41f0003a30 0x7f42080a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420814f410 0x7f420814f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42081ef2d0 0x7f42081ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f42080c5790 con 0x7f42081ef2d0 2024-04-25T13:47:12.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f42080c2d10 con 0x7f420814f410 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420d1a4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f42080c5910 con 0x7f41f0003a30 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42081ef2d0 0x7f42081ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42081ef2d0 0x7f42081ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60666/0 (socket says 172.21.15.77:60666) 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420759e640 1 -- 172.21.15.77:0/3272605364 learned_addr learned my addr 172.21.15.77:0/3272605364 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f4206d9d640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41f0003a30 0x7f42080a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420659c640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420814f410 0x7f420814f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420759e640 1 -- 172.21.15.77:0/3272605364 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41f0003a30 msgr2=0x7f42080a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420759e640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41f0003a30 0x7f42080a7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420759e640 1 -- 172.21.15.77:0/3272605364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420814f410 msgr2=0x7f420814f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420759e640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420814f410 0x7f420814f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420759e640 1 -- 172.21.15.77:0/3272605364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42080bc9c0 con 0x7f42081ef2d0 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420659c640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420814f410 0x7f420814f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.970+0000 7f420759e640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42081ef2d0 0x7f42081ef6e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4200000f90 tx=0x7f420000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f41ef7fe640 1 -- 172.21.15.77:0/3272605364 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200004d70 con 0x7f42081ef2d0 2024-04-25T13:47:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f41ef7fe640 1 -- 172.21.15.77:0/3272605364 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420000bb80 con 0x7f42081ef2d0 2024-04-25T13:47:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42080bcca0 con 0x7f42081ef2d0 2024-04-25T13:47:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f41ef7fe640 1 -- 172.21.15.77:0/3272605364 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200007070 con 0x7f42081ef2d0 2024-04-25T13:47:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42081f0000 con 0x7f42081ef2d0 2024-04-25T13:47:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f420806a1a0 con 0x7f42081ef2d0 2024-04-25T13:47:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f41ef7fe640 1 -- 172.21.15.77:0/3272605364 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f420001b060 con 0x7f42081ef2d0 2024-04-25T13:47:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f41ef7fe640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f41f406f400 0x7f41f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f41ef7fe640 1 -- 172.21.15.77:0/3272605364 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f420008f200 con 0x7f42081ef2d0 2024-04-25T13:47:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f4206d9d640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f41f406f400 0x7f41f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.974+0000 7f4206d9d640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f41f406f400 0x7f41f4071910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41f8001750 tx=0x7f41f80011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:12.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:12.978+0000 7f41ef7fe640 1 -- 172.21.15.77:0/3272605364 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f420005c180 con 0x7f42081ef2d0 2024-04-25T13:47:13.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.125+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f420806ef40 con 0x7f41f406f400 2024-04-25T13:47:13.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.125+0000 7f41ef7fe640 1 -- 172.21.15.77:0/3272605364 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f420806ef40 con 0x7f41f406f400 2024-04-25T13:47:13.129 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T13:47:13.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f41f406f400 msgr2=0x7f41f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f41f406f400 0x7f41f4071910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41f8001750 tx=0x7f41f80011a0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42081ef2d0 msgr2=0x7f42081ef6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42081ef2d0 0x7f42081ef6e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4200000f90 tx=0x7f420000b4a0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 shutdown_connections 2024-04-25T13:47:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f41f406f400 0x7f41f4071910 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42081ef2d0 0x7f42081ef6e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f420814f410 0x7f420814f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 --2- 172.21.15.77:0/3272605364 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41f0003a30 0x7f42080a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 >> 172.21.15.77:0/3272605364 conn(0x7f42080c7890 msgr2=0x7f4208151860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 shutdown_connections 2024-04-25T13:47:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.129+0000 7f420d1a4640 1 -- 172.21.15.77:0/3272605364 wait complete. 2024-04-25T13:47:13.149 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T13:47:13.149 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:47:13.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.293+0000 7f1885ae2640 1 Processor -- start 2024-04-25T13:47:13.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.293+0000 7f1885ae2640 1 -- start start 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f1885ae2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1880073d70 0x7f188006f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f1885ae2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1880150120 con 0x7f188014f600 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f1885ae2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18800a6b70 con 0x7f18801505e0 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f1885ae2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f18800a75f0 con 0x7f1880073d70 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f188014f600 0x7f188014fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46632/0 (socket says 172.21.15.77:46632) 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187effd640 1 -- 172.21.15.77:0/1564305466 learned_addr learned my addr 172.21.15.77:0/1564305466 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849340537 0 0) 0x7f1874001120 con 0x7f188014f600 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187f7fe640 1 --2- 172.21.15.77:0/1564305466 >> v2:172.21.15.96:3300/0 conn(0x7f1880073d70 0x7f188006f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1868003530 con 0x7f188014f600 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 445187170 0 0) 0x7f1868003530 con 0x7f188014f600 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 >> v2:172.21.15.96:3300/0 conn(0x7f1880073d70 msgr2=0x7f188006f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 --2- 172.21.15.77:0/1564305466 >> v2:172.21.15.96:3300/0 conn(0x7f1880073d70 0x7f188006f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 >> v1:172.21.15.96:6789/0 conn(0x7f18801505e0 legacy=0x7f18801509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18800a6e50 con 0x7f188014f600 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f1874001850 con 0x7f188014f600 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 >> v1:172.21.15.77:6789/0 conn(0x7f188014f600 legacy=0x7f188014fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18680039c0 0x7f1868003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1868004810 0x7f1868004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f186800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f186800c140 con 0x7f18680051d0 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f186800c2f0 con 0x7f18680039c0 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f186800c4f0 con 0x7f1868004810 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187ffff640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f186800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187effd640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1868004810 0x7f1868004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187f7fe640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18680039c0 0x7f1868003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187ffff640 1 -- 172.21.15.77:0/1564305466 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1868004810 msgr2=0x7f1868004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:13.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187ffff640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1868004810 0x7f1868004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187ffff640 1 -- 172.21.15.77:0/1564305466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18680039c0 msgr2=0x7f1868003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:13.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187ffff640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18680039c0 0x7f1868003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187ffff640 1 -- 172.21.15.77:0/1564305466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1868003530 con 0x7f18680051d0 2024-04-25T13:47:13.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.297+0000 7f187ffff640 1 -- 172.21.15.77:0/1564305466 reap_dead start 2024-04-25T13:47:13.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f187ffff640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f186800b9d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1878001e70 tx=0x7f187801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6408f6e3812d02c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878001a90 con 0x7f18680051d0 2024-04-25T13:47:13.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1878003ba0 con 0x7f18680051d0 2024-04-25T13:47:13.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f187e7fc640 1 -- 172.21.15.77:0/1564305466 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780050d0 con 0x7f18680051d0 2024-04-25T13:47:13.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 -- 172.21.15.77:0/1564305466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 msgr2=0x7f186800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f186800b9d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1878001e70 tx=0x7f187801c6e0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 -- 172.21.15.77:0/1564305466 shutdown_connections 2024-04-25T13:47:13.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 --2- 172.21.15.77:0/1564305466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f186800b9d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 -- 172.21.15.77:0/1564305466 >> 172.21.15.77:0/1564305466 conn(0x7f18800c37a0 msgr2=0x7f18800c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:13.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 -- 172.21.15.77:0/1564305466 shutdown_connections 2024-04-25T13:47:13.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 -- 172.21.15.77:0/1564305466 wait complete. 2024-04-25T13:47:13.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 Processor -- start 2024-04-25T13:47:13.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 -- start start 2024-04-25T13:47:13.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f18800bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f188014a5a0 0x7f1880149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1880149f50 0x7f18801e6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f188014fa10 con 0x7f18680051d0 2024-04-25T13:47:13.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f188014fb90 con 0x7f1880149f50 2024-04-25T13:47:13.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f1885ae2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f188014fd10 con 0x7f188014a5a0 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f187f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f18800bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f187f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f18800bbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60688/0 (socket says 172.21.15.77:60688) 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.301+0000 7f187f7fe640 1 -- 172.21.15.77:0/1917222453 learned_addr learned my addr 172.21.15.77:0/1917222453 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187effd640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f188014a5a0 0x7f1880149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187ffff640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1880149f50 0x7f18801e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187f7fe640 1 -- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f188014a5a0 msgr2=0x7f1880149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187f7fe640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f188014a5a0 0x7f1880149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187f7fe640 1 -- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1880149f50 msgr2=0x7f18801e6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187f7fe640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1880149f50 0x7f18801e6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187f7fe640 1 -- 172.21.15.77:0/1917222453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18800b9e70 con 0x7f18680051d0 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187ffff640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1880149f50 0x7f18801e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187f7fe640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f18800bbbb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f18700115c0 tx=0x7f1870011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1867fff640 1 -- 172.21.15.77:0/1917222453 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870015870 con 0x7f18680051d0 2024-04-25T13:47:13.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1867fff640 1 -- 172.21.15.77:0/1917222453 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1870015a10 con 0x7f18680051d0 2024-04-25T13:47:13.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188014a360 con 0x7f18680051d0 2024-04-25T13:47:13.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1867fff640 1 -- 172.21.15.77:0/1917222453 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870015dc0 con 0x7f18680051d0 2024-04-25T13:47:13.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18800bb3c0 con 0x7f18680051d0 2024-04-25T13:47:13.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18800bb5c0 con 0x7f18680051d0 2024-04-25T13:47:13.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1867fff640 1 -- 172.21.15.77:0/1917222453 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f187000f460 con 0x7f18680051d0 2024-04-25T13:47:13.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1867fff640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f186c06f400 0x7f186c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1867fff640 1 -- 172.21.15.77:0/1917222453 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f187008fd30 con 0x7f18680051d0 2024-04-25T13:47:13.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187effd640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f186c06f400 0x7f186c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1867fff640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f186c0777d0 0x7f186c079cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1867fff640 1 -- 172.21.15.77:0/1917222453 --> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f186c07a390 con 0x7f186c0777d0 2024-04-25T13:47:13.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f1867fff640 1 -- 172.21.15.77:0/1917222453 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f18700901c0 con 0x7f18680051d0 2024-04-25T13:47:13.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187effd640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f186c06f400 0x7f186c071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18800bccf0 tx=0x7f1874009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187ffff640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f186c0777d0 0x7f186c079cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.305+0000 7f187ffff640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f186c0777d0 0x7f186c079cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.309+0000 7f1867fff640 1 -- 172.21.15.77:0/1917222453 <== osd.4 v2:172.21.15.96:6824/779501835 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f186c07a390 con 0x7f186c0777d0 2024-04-25T13:47:13.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 --> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f18800b9cc0 con 0x7f186c0777d0 2024-04-25T13:47:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1867fff640 1 -- 172.21.15.77:0/1917222453 <== osd.4 v2:172.21.15.96:6824/779501835 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f18780af070 con 0x7f186c0777d0 2024-04-25T13:47:13.323 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T13:47:13.323 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:47:13.323 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T13:47:13.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f186c0777d0 msgr2=0x7f186c079cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.96:6824/779501835,v1:172.21.15.96:6825/779501835] conn(0x7f186c0777d0 0x7f186c079cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f186c06f400 msgr2=0x7f186c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f186c06f400 0x7f186c071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18800bccf0 tx=0x7f1874009040 comp rx=0 tx=0).stop 2024-04-25T13:47:13.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 msgr2=0x7f18800bbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 --2- 172.21.15.77:0/1917222453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18680051d0 0x7f18800bbbb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f18700115c0 tx=0x7f1870011a80 comp rx=0 tx=0).stop 2024-04-25T13:47:13.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f187ffff640 1 -- 172.21.15.77:0/1917222453 reap_dead start 2024-04-25T13:47:13.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 shutdown_connections 2024-04-25T13:47:13.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 >> 172.21.15.77:0/1917222453 conn(0x7f18800c37a0 msgr2=0x7f18800756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:13.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 shutdown_connections 2024-04-25T13:47:13.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.321+0000 7f1885ae2640 1 -- 172.21.15.77:0/1917222453 wait complete. 2024-04-25T13:47:13.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T13:47:13.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.473+0000 7fa2f2396640 1 Processor -- start 2024-04-25T13:47:13.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.473+0000 7fa2f2396640 1 -- start start 2024-04-25T13:47:13.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2f2396640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa2ec0a8bd0 0x7fa2ec073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2f2396640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec14e710 0x7fa2ec14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2f2396640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2ec14f2a0 con 0x7fa2ec06fa90 2024-04-25T13:47:13.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2f2396640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fa2ec14f060 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2f2396640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fa2ec1535a0 con 0x7fa2ec14e710 2024-04-25T13:47:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2ebfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa2ec0a8bd0 0x7fa2ec073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2f0933640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec14e710 0x7fa2ec14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2ebfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa2ec0a8bd0 0x7fa2ec073bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:53928/0 (socket says 172.21.15.77:53928) 2024-04-25T13:47:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2ebfff640 1 -- 172.21.15.77:0/2748625435 learned_addr learned my addr 172.21.15.77:0/2748625435 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2eb7fe640 1 --1- 172.21.15.77:0/2748625435 >> v1:172.21.15.96:6789/0 conn(0x7fa2ec06fa90 0x7fa2ec14faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.77:58444/0 (socket says 172.21.15.77:58444) 2024-04-25T13:47:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2ebfff640 1 -- 172.21.15.77:0/2748625435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec14e710 msgr2=0x7fa2ec14eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:13.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2ebfff640 1 --2- 172.21.15.77:0/2748625435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec14e710 0x7fa2ec14eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2ebfff640 1 -- 172.21.15.77:0/2748625435 >> v1:172.21.15.96:6789/0 conn(0x7fa2ec06fa90 legacy=0x7fa2ec14faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2ebfff640 1 -- 172.21.15.77:0/2748625435 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ec14f580 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.477+0000 7fa2ebfff640 1 --2- 172.21.15.77:0/2748625435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0a8bd0 0x7fa2ec073bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009e50 tx=0x7fa2e401c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba15a215dc34e86d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2eaffd640 1 -- 172.21.15.77:0/2748625435 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40a58b0 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2eaffd640 1 -- 172.21.15.77:0/2748625435 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e40a5a50 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2eaffd640 1 -- 172.21.15.77:0/2748625435 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40a5e20 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 -- 172.21.15.77:0/2748625435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0a8bd0 msgr2=0x7fa2ec073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 --2- 172.21.15.77:0/2748625435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0a8bd0 0x7fa2ec073bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009e50 tx=0x7fa2e401c9d0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 -- 172.21.15.77:0/2748625435 shutdown_connections 2024-04-25T13:47:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 --2- 172.21.15.77:0/2748625435 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec14e710 0x7fa2ec14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 --2- 172.21.15.77:0/2748625435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec0a8bd0 0x7fa2ec073bf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 -- 172.21.15.77:0/2748625435 >> 172.21.15.77:0/2748625435 conn(0x7fa2ec0c4ae0 msgr2=0x7fa2ec0c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:13.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 -- 172.21.15.77:0/2748625435 shutdown_connections 2024-04-25T13:47:13.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 -- 172.21.15.77:0/2748625435 wait complete. 2024-04-25T13:47:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 Processor -- start 2024-04-25T13:47:13.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 -- start start 2024-04-25T13:47:13.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec06fa90 0x7fa2ec14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2ec0a8bd0 0x7fa2ec14b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec14e710 0x7fa2ec1589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec070020 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec06fea0 con 0x7fa2ec14e710 2024-04-25T13:47:13.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2f2396640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fa2ec15a210 con 0x7fa2ec06fa90 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2ec0a8bd0 0x7fa2ec14b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2ec0a8bd0 0x7fa2ec14b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60704/0 (socket says 172.21.15.77:60704) 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.481+0000 7fa2eb7fe640 1 -- 172.21.15.77:0/1316108441 learned_addr learned my addr 172.21.15.77:0/1316108441 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2ebfff640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec06fa90 0x7fa2ec14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2f0933640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec14e710 0x7fa2ec1589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2eb7fe640 1 -- 172.21.15.77:0/1316108441 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec06fa90 msgr2=0x7fa2ec14c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2eb7fe640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec06fa90 0x7fa2ec14c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2eb7fe640 1 -- 172.21.15.77:0/1316108441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec14e710 msgr2=0x7fa2ec1589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2eb7fe640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec14e710 0x7fa2ec1589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2eb7fe640 1 -- 172.21.15.77:0/1316108441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ec1e9950 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2f0933640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec14e710 0x7fa2ec1589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2eb7fe640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2ec0a8bd0 0x7fa2ec14b970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00c460 tx=0x7fa2dc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2e8ff9640 1 -- 172.21.15.77:0/1316108441 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc018070 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2e8ff9640 1 -- 172.21.15.77:0/1316108441 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2dc007480 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2ec14e110 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2e8ff9640 1 -- 172.21.15.77:0/1316108441 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc0047f0 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2ec149330 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2ec149e10 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2e8ff9640 1 -- 172.21.15.77:0/1316108441 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa2dc01b070 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2e8ff9640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa2d806f400 0x7fa2d8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2e8ff9640 1 -- 172.21.15.77:0/1316108441 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fa2dc08e730 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2ebfff640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa2d806f400 0x7fa2d8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.485+0000 7fa2ebfff640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa2d806f400 0x7fa2d8071910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40ae000 tx=0x7fa2e40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.489+0000 7fa2e8ff9640 1 -- 172.21.15.77:0/1316108441 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa2dc05b790 con 0x7fa2ec0a8bd0 2024-04-25T13:47:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa2ec06a1a0 con 0x7fa2d806f400 2024-04-25T13:47:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2e8ff9640 1 -- 172.21.15.77:0/1316108441 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa2ec06a1a0 con 0x7fa2d806f400 2024-04-25T13:47:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T13:47:13.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa2d806f400 msgr2=0x7fa2d8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa2d806f400 0x7fa2d8071910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40ae000 tx=0x7fa2e40a7070 comp rx=0 tx=0).stop 2024-04-25T13:47:13.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2ec0a8bd0 msgr2=0x7fa2ec14b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2ec0a8bd0 0x7fa2ec14b970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00c460 tx=0x7fa2dc00c920 comp rx=0 tx=0).stop 2024-04-25T13:47:13.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 shutdown_connections 2024-04-25T13:47:13.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa2d806f400 0x7fa2d8071910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2ec14e710 0x7fa2ec1589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2ec0a8bd0 0x7fa2ec14b970 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 --2- 172.21.15.77:0/1316108441 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2ec06fa90 0x7fa2ec14c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 >> 172.21.15.77:0/1316108441 conn(0x7fa2ec0c4ae0 msgr2=0x7fa2ec0c18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:13.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 shutdown_connections 2024-04-25T13:47:13.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.653+0000 7fa2f2396640 1 -- 172.21.15.77:0/1316108441 wait complete. 2024-04-25T13:47:13.675 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T13:47:13.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:47:13.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.813+0000 7f2399426640 1 Processor -- start 2024-04-25T13:47:13.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.813+0000 7f2399426640 1 -- start start 2024-04-25T13:47:13.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2399426640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f23940a5e30 0x7f23940a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2399426640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2394148c20 0x7f2394149030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2399426640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f23941526e0 0x7f2394152af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2399426640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2394073ae0 con 0x7f23941526e0 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2399426640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2394149570 con 0x7f2394148c20 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2399426640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f23940a7fa0 con 0x7f23940a5e30 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23937fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f23941526e0 0x7f2394152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23937fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f23941526e0 0x7f2394152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60706/0 (socket says 172.21.15.77:60706) 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23937fe640 1 -- 172.21.15.77:0/2991245661 learned_addr learned my addr 172.21.15.77:0/2991245661 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2392ffd640 1 --2- 172.21.15.77:0/2991245661 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f23940a5e30 0x7f23940a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23927fc640 1 --2- 172.21.15.77:0/2991245661 >> v2:172.21.15.96:3300/0 conn(0x7f2394148c20 0x7f2394149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23937fe640 1 -- 172.21.15.77:0/2991245661 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f23940a5e30 msgr2=0x7f23940a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23937fe640 1 --2- 172.21.15.77:0/2991245661 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f23940a5e30 0x7f23940a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23937fe640 1 -- 172.21.15.77:0/2991245661 >> v2:172.21.15.96:3300/0 conn(0x7f2394148c20 msgr2=0x7f2394149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:13.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23937fe640 1 --2- 172.21.15.77:0/2991245661 >> v2:172.21.15.96:3300/0 conn(0x7f2394148c20 0x7f2394149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23937fe640 1 -- 172.21.15.77:0/2991245661 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2394071b70 con 0x7f23941526e0 2024-04-25T13:47:13.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f23937fe640 1 --2- 172.21.15.77:0/2991245661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23941526e0 0x7f2394152af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f23940c45d0 tx=0x7f238c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63838b72946394eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2391ffb640 1 -- 172.21.15.77:0/2991245661 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c0a55e0 con 0x7f23941526e0 2024-04-25T13:47:13.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2391ffb640 1 -- 172.21.15.77:0/2991245661 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c0a5780 con 0x7f23941526e0 2024-04-25T13:47:13.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.817+0000 7f2391ffb640 1 -- 172.21.15.77:0/2991245661 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c0a5b50 con 0x7f23941526e0 2024-04-25T13:47:13.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 -- 172.21.15.77:0/2991245661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23941526e0 msgr2=0x7f2394152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 --2- 172.21.15.77:0/2991245661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23941526e0 0x7f2394152af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f23940c45d0 tx=0x7f238c01c960 comp rx=0 tx=0).stop 2024-04-25T13:47:13.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 -- 172.21.15.77:0/2991245661 shutdown_connections 2024-04-25T13:47:13.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 --2- 172.21.15.77:0/2991245661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23941526e0 0x7f2394152af0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 --2- 172.21.15.77:0/2991245661 >> v2:172.21.15.96:3300/0 conn(0x7f2394148c20 0x7f2394149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 --2- 172.21.15.77:0/2991245661 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f23940a5e30 0x7f23940a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 -- 172.21.15.77:0/2991245661 >> 172.21.15.77:0/2991245661 conn(0x7f23940c37a0 msgr2=0x7f23940c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:13.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 -- 172.21.15.77:0/2991245661 shutdown_connections 2024-04-25T13:47:13.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 -- 172.21.15.77:0/2991245661 wait complete. 2024-04-25T13:47:13.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 Processor -- start 2024-04-25T13:47:13.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 -- start start 2024-04-25T13:47:13.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23940a5e30 0x7f2394140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2394148c20 0x7f2394145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f23941526e0 0x7f23941ea290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f239406f970 con 0x7f23940a5e30 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f239406f7f0 con 0x7f2394148c20 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2399426640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f239406faf0 con 0x7f23941526e0 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2392ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23940a5e30 0x7f2394140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2392ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23940a5e30 0x7f2394140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60716/0 (socket says 172.21.15.77:60716) 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f2392ffd640 1 -- 172.21.15.77:0/2004009185 learned_addr learned my addr 172.21.15.77:0/2004009185 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.821+0000 7f23927fc640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2394148c20 0x7f2394145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f23937fe640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f23941526e0 0x7f23941ea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f2392ffd640 1 -- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f23941526e0 msgr2=0x7f23941ea290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f2392ffd640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f23941526e0 0x7f23941ea290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f2392ffd640 1 -- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2394148c20 msgr2=0x7f2394145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f2392ffd640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2394148c20 0x7f2394145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f2392ffd640 1 -- 172.21.15.77:0/2004009185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23941e7990 con 0x7f23940a5e30 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f23927fc640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2394148c20 0x7f2394145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f2392ffd640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23940a5e30 0x7f2394140300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f238400d830 tx=0x7f238400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f237b7fe640 1 -- 172.21.15.77:0/2004009185 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384018030 con 0x7f23940a5e30 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f237b7fe640 1 -- 172.21.15.77:0/2004009185 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238400be10 con 0x7f23940a5e30 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23941eac50 con 0x7f23940a5e30 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f237b7fe640 1 -- 172.21.15.77:0/2004009185 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23840098b0 con 0x7f23940a5e30 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2394143210 con 0x7f23940a5e30 2024-04-25T13:47:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f239406a2f0 con 0x7f23940a5e30 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f237b7fe640 1 -- 172.21.15.77:0/2004009185 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f238401b070 con 0x7f23940a5e30 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f237b7fe640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f238006f430 0x7f2380071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f237b7fe640 1 -- 172.21.15.77:0/2004009185 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f238408f9a0 con 0x7f23940a5e30 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f23927fc640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f238006f430 0x7f2380071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f237b7fe640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f2380077860 0x7f2380079d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f237b7fe640 1 -- 172.21.15.77:0/2004009185 --> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2384027e50 con 0x7f2380077860 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f237b7fe640 1 -- 172.21.15.77:0/2004009185 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f238408fe80 con 0x7f23940a5e30 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f23927fc640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f238006f430 0x7f2380071940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2394073120 tx=0x7f2388008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f23937fe640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f2380077860 0x7f2380079d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.825+0000 7f23937fe640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f2380077860 0x7f2380079d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:13.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.829+0000 7f237b7fe640 1 -- 172.21.15.77:0/2004009185 <== osd.5 v2:172.21.15.96:6800/3584918430 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2384027e50 con 0x7f2380077860 2024-04-25T13:47:13.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 --> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f239414b830 con 0x7f2380077860 2024-04-25T13:47:13.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f237b7fe640 1 -- 172.21.15.77:0/2004009185 <== osd.5 v2:172.21.15.96:6800/3584918430 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f239414b830 con 0x7f2380077860 2024-04-25T13:47:13.843 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T13:47:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:47:13.843 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T13:47:13.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f2380077860 msgr2=0x7f2380079d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.96:6800/3584918430,v1:172.21.15.96:6801/3584918430] conn(0x7f2380077860 0x7f2380079d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f238006f430 msgr2=0x7f2380071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f238006f430 0x7f2380071940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2394073120 tx=0x7f2388008040 comp rx=0 tx=0).stop 2024-04-25T13:47:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23940a5e30 msgr2=0x7f2394140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 --2- 172.21.15.77:0/2004009185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23940a5e30 0x7f2394140300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f238400d830 tx=0x7f238400dcf0 comp rx=0 tx=0).stop 2024-04-25T13:47:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f23937fe640 1 -- 172.21.15.77:0/2004009185 reap_dead start 2024-04-25T13:47:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 shutdown_connections 2024-04-25T13:47:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 >> 172.21.15.77:0/2004009185 conn(0x7f23940c37a0 msgr2=0x7f23940c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 shutdown_connections 2024-04-25T13:47:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:13.841+0000 7f2399426640 1 -- 172.21.15.77:0/2004009185 wait complete. 2024-04-25T13:47:13.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T13:47:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.001+0000 7f6f4d3e4640 1 Processor -- start 2024-04-25T13:47:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.001+0000 7f6f4d3e4640 1 -- start start 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.001+0000 7f6f4d3e4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4806fba0 0x7f6f4814f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.001+0000 7f6f4d3e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f4814fc40 0x7f6f48153870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.001+0000 7f6f4d3e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f480741b0 con 0x7f6f48153db0 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.001+0000 7f6f4d3e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6f48071b10 con 0x7f6f4814fc40 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.001+0000 7f6f4d3e4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6f480bfe40 con 0x7f6f4806fba0 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f467fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f4814fc40 0x7f6f48153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f477fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6f48153db0 0x7f6f48072e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46646/0 (socket says 172.21.15.77:46646) 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f477fe640 1 -- 172.21.15.77:0/3349123344 learned_addr learned my addr 172.21.15.77:0/3349123344 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f46ffd640 1 --2- 172.21.15.77:0/3349123344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4806fba0 0x7f6f4814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f467fc640 1 -- 172.21.15.77:0/3349123344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4806fba0 msgr2=0x7f6f4814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f45ffb640 1 -- 172.21.15.77:0/3349123344 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1586506572 0 0) 0x7f6f480741b0 con 0x7f6f48153db0 2024-04-25T13:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f467fc640 1 --2- 172.21.15.77:0/3349123344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4806fba0 0x7f6f4814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f467fc640 1 -- 172.21.15.77:0/3349123344 >> v1:172.21.15.77:6789/0 conn(0x7f6f48153db0 legacy=0x7f6f48072e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f467fc640 1 -- 172.21.15.77:0/3349123344 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f48150050 con 0x7f6f4814fc40 2024-04-25T13:47:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f467fc640 1 --2- 172.21.15.77:0/3349123344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 0x7f6f48153870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0097c0 tx=0x7f6f3c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149c007c49583048 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f45ffb640 1 -- 172.21.15.77:0/3349123344 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0b0070 con 0x7f6f4814fc40 2024-04-25T13:47:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f45ffb640 1 -- 172.21.15.77:0/3349123344 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c0ab600 con 0x7f6f4814fc40 2024-04-25T13:47:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f45ffb640 1 -- 172.21.15.77:0/3349123344 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0ab9d0 con 0x7f6f4814fc40 2024-04-25T13:47:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/3349123344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 msgr2=0x7f6f48153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f4d3e4640 1 --2- 172.21.15.77:0/3349123344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 0x7f6f48153870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0097c0 tx=0x7f6f3c01c410 comp rx=0 tx=0).stop 2024-04-25T13:47:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/3349123344 shutdown_connections 2024-04-25T13:47:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f4d3e4640 1 --2- 172.21.15.77:0/3349123344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 0x7f6f48153870 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f4d3e4640 1 --2- 172.21.15.77:0/3349123344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4806fba0 0x7f6f4814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/3349123344 >> 172.21.15.77:0/3349123344 conn(0x7f6f480c3cd0 msgr2=0x7f6f480c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/3349123344 shutdown_connections 2024-04-25T13:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.005+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/3349123344 wait complete. 2024-04-25T13:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 Processor -- start 2024-04-25T13:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 -- start start 2024-04-25T13:47:14.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f4806fba0 0x7f6f481eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 0x7f6f48153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f48153db0 0x7f6f48148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4815dc20 con 0x7f6f4814fc40 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480a8cc0 con 0x7f6f4806fba0 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4815dda0 con 0x7f6f48153db0 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f467fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 0x7f6f48153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f467fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 0x7f6f48153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60722/0 (socket says 172.21.15.77:60722) 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f467fc640 1 -- 172.21.15.77:0/4038117883 learned_addr learned my addr 172.21.15.77:0/4038117883 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f477fe640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f48153db0 0x7f6f48148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f46ffd640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f4806fba0 0x7f6f481eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f467fc640 1 -- 172.21.15.77:0/4038117883 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f48153db0 msgr2=0x7f6f48148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f467fc640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f48153db0 0x7f6f48148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f467fc640 1 -- 172.21.15.77:0/4038117883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f4806fba0 msgr2=0x7f6f481eadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f467fc640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f4806fba0 0x7f6f481eadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f467fc640 1 -- 172.21.15.77:0/4038117883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f481ecfb0 con 0x7f6f4814fc40 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f46ffd640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f4806fba0 0x7f6f481eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f467fc640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 0x7f6f48153620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c01a040 tx=0x7f6f3c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f2f7fe640 1 -- 172.21.15.77:0/4038117883 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0b8020 con 0x7f6f4814fc40 2024-04-25T13:47:14.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f2f7fe640 1 -- 172.21.15.77:0/4038117883 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c0b4410 con 0x7f6f4814fc40 2024-04-25T13:47:14.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f481edd00 con 0x7f6f4814fc40 2024-04-25T13:47:14.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f2f7fe640 1 -- 172.21.15.77:0/4038117883 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0b0040 con 0x7f6f4814fc40 2024-04-25T13:47:14.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.009+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f48152e20 con 0x7f6f4814fc40 2024-04-25T13:47:14.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.013+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f4806a1a0 con 0x7f6f4814fc40 2024-04-25T13:47:14.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.013+0000 7f6f2f7fe640 1 -- 172.21.15.77:0/4038117883 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6f3c0bb020 con 0x7f6f4814fc40 2024-04-25T13:47:14.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.013+0000 7f6f2f7fe640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f3406f400 0x7f6f34071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.013+0000 7f6f46ffd640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f3406f400 0x7f6f34071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.013+0000 7f6f2f7fe640 1 -- 172.21.15.77:0/4038117883 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f6f3c128f00 con 0x7f6f4814fc40 2024-04-25T13:47:14.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.013+0000 7f6f46ffd640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f3406f400 0x7f6f34071910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009a40 tx=0x7f6f38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.017+0000 7f6f2f7fe640 1 -- 172.21.15.77:0/4038117883 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f3c0c2030 con 0x7f6f4814fc40 2024-04-25T13:47:14.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f6f480c2d20 con 0x7f6f3406f400 2024-04-25T13:47:14.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f2f7fe640 1 -- 172.21.15.77:0/4038117883 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6f480c2d20 con 0x7f6f3406f400 2024-04-25T13:47:14.174 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T13:47:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f3406f400 msgr2=0x7f6f34071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f3406f400 0x7f6f34071910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009a40 tx=0x7f6f38008040 comp rx=0 tx=0).stop 2024-04-25T13:47:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 msgr2=0x7f6f48153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 0x7f6f48153620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c01a040 tx=0x7f6f3c0191b0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 shutdown_connections 2024-04-25T13:47:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f6f3406f400 0x7f6f34071910 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f48153db0 0x7f6f48148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f4814fc40 0x7f6f48153620 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 --2- 172.21.15.77:0/4038117883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f4806fba0 0x7f6f481eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 >> 172.21.15.77:0/4038117883 conn(0x7f6f480c3cd0 msgr2=0x7f6f48150a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 shutdown_connections 2024-04-25T13:47:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.173+0000 7f6f4d3e4640 1 -- 172.21.15.77:0/4038117883 wait complete. 2024-04-25T13:47:14.193 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T13:47:14.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:47:14.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.345+0000 7f82fd421640 1 Processor -- start 2024-04-25T13:47:14.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.345+0000 7f82fd421640 1 -- start start 2024-04-25T13:47:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82fd421640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806d910 0x7f82f806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82fd421640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f82f80c1fe0 0x7f82f80c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82fd421640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f80a6d20 con 0x7f82f80c3440 2024-04-25T13:47:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82fd421640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f82f80c3850 con 0x7f82f80c1fe0 2024-04-25T13:47:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82fd421640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f82f80a6ad0 con 0x7f82f806d910 2024-04-25T13:47:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f82f80c1fe0 0x7f82f80c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f82f80c1fe0 0x7f82f80c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60734/0 (socket says 172.21.15.77:60734) 2024-04-25T13:47:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f77fe640 1 -- 172.21.15.77:0/1067619789 learned_addr learned my addr 172.21.15.77:0/1067619789 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:14.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82ee7fc640 1 --2- 172.21.15.77:0/1067619789 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806d910 0x7f82f806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f77fe640 1 -- 172.21.15.77:0/1067619789 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806d910 msgr2=0x7f82f806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:14.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f77fe640 1 --2- 172.21.15.77:0/1067619789 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806d910 0x7f82f806dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f77fe640 1 -- 172.21.15.77:0/1067619789 >> v1:172.21.15.96:6789/0 conn(0x7f82f80c3440 legacy=0x7f82f80ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:14.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f77fe640 1 -- 172.21.15.77:0/1067619789 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f81530f0 con 0x7f82f80c1fe0 2024-04-25T13:47:14.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f77fe640 1 --2- 172.21.15.77:0/1067619789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c1fe0 0x7f82f80c23f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009e50 tx=0x7f82f001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6620d1e250e50254 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f67fc640 1 -- 172.21.15.77:0/1067619789 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f00a5670 con 0x7f82f80c1fe0 2024-04-25T13:47:14.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f67fc640 1 -- 172.21.15.77:0/1067619789 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f00a5810 con 0x7f82f80c1fe0 2024-04-25T13:47:14.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.349+0000 7f82f67fc640 1 -- 172.21.15.77:0/1067619789 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f00a5be0 con 0x7f82f80c1fe0 2024-04-25T13:47:14.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 -- 172.21.15.77:0/1067619789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c1fe0 msgr2=0x7f82f80c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 --2- 172.21.15.77:0/1067619789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c1fe0 0x7f82f80c23f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009e50 tx=0x7f82f001c9f0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 -- 172.21.15.77:0/1067619789 shutdown_connections 2024-04-25T13:47:14.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 --2- 172.21.15.77:0/1067619789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c1fe0 0x7f82f80c23f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 --2- 172.21.15.77:0/1067619789 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806d910 0x7f82f806dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 -- 172.21.15.77:0/1067619789 >> 172.21.15.77:0/1067619789 conn(0x7f82f80a9fb0 msgr2=0x7f82f80c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:14.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 -- 172.21.15.77:0/1067619789 shutdown_connections 2024-04-25T13:47:14.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 -- 172.21.15.77:0/1067619789 wait complete. 2024-04-25T13:47:14.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 Processor -- start 2024-04-25T13:47:14.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 -- start start 2024-04-25T13:47:14.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806d910 0x7f82f80a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80c1fe0 0x7f82f80b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c3440 0x7f82f80ba280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82f815f940 con 0x7f82f80c3440 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f82f8153460 con 0x7f82f80c1fe0 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82fd421640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f82f815fac0 con 0x7f82f806d910 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c3440 0x7f82f80ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c3440 0x7f82f80ba280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60746/0 (socket says 172.21.15.77:60746) 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.353+0000 7f82f77fe640 1 -- 172.21.15.77:0/2395531882 learned_addr learned my addr 172.21.15.77:0/2395531882 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82f6ffd640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806d910 0x7f82f80a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82ee7fc640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80c1fe0 0x7f82f80b9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82f77fe640 1 -- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806d910 msgr2=0x7f82f80a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82f77fe640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f82f806d910 0x7f82f80a7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82f77fe640 1 -- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80c1fe0 msgr2=0x7f82f80b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82f77fe640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80c1fe0 0x7f82f80b9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82f77fe640 1 -- 172.21.15.77:0/2395531882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f80a8320 con 0x7f82f80c3440 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82ee7fc640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80c1fe0 0x7f82f80b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82f77fe640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c3440 0x7f82f80ba280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f82f00af040 tx=0x7f82f0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82effff640 1 -- 172.21.15.77:0/2395531882 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f00a5670 con 0x7f82f80c3440 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82effff640 1 -- 172.21.15.77:0/2395531882 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f00be070 con 0x7f82f80c3440 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f81ef9b0 con 0x7f82f80c3440 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82effff640 1 -- 172.21.15.77:0/2395531882 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0009510 con 0x7f82f80c3440 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f80be100 con 0x7f82f80c3440 2024-04-25T13:47:14.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82f81f0070 con 0x7f82f80c3440 2024-04-25T13:47:14.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82effff640 1 -- 172.21.15.77:0/2395531882 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f82f00b8470 con 0x7f82f80c3440 2024-04-25T13:47:14.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82effff640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82d806f400 0x7f82d8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82effff640 1 -- 172.21.15.77:0/2395531882 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f82f012b360 con 0x7f82f80c3440 2024-04-25T13:47:14.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82f6ffd640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82d806f400 0x7f82d8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82effff640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f82d8077830 0x7f82d8079d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82effff640 1 -- 172.21.15.77:0/2395531882 --> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82f00a5810 con 0x7f82d8077830 2024-04-25T13:47:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82effff640 1 -- 172.21.15.77:0/2395531882 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f82f012b7f0 con 0x7f82f80c3440 2024-04-25T13:47:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82f6ffd640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82d806f400 0x7f82d8071910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82e800b810 tx=0x7f82e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.357+0000 7f82ee7fc640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f82d8077830 0x7f82d8079d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.361+0000 7f82ee7fc640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f82d8077830 0x7f82d8079d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.361+0000 7f82effff640 1 -- 172.21.15.77:0/2395531882 <== osd.6 v2:172.21.15.96:6808/4031837167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82f00a5810 con 0x7f82d8077830 2024-04-25T13:47:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.373+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 --> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f82f80be3e0 con 0x7f82d8077830 2024-04-25T13:47:14.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.373+0000 7f82effff640 1 -- 172.21.15.77:0/2395531882 <== osd.6 v2:172.21.15.96:6808/4031837167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f82f80be3e0 con 0x7f82d8077830 2024-04-25T13:47:14.376 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T13:47:14.376 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:47:14.377 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T13:47:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f82d8077830 msgr2=0x7f82d8079d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.96:6808/4031837167,v1:172.21.15.96:6809/4031837167] conn(0x7f82d8077830 0x7f82d8079d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82d806f400 msgr2=0x7f82d8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f82d806f400 0x7f82d8071910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82e800b810 tx=0x7f82e8008040 comp rx=0 tx=0).stop 2024-04-25T13:47:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c3440 msgr2=0x7f82f80ba280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 --2- 172.21.15.77:0/2395531882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f80c3440 0x7f82f80ba280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f82f00af040 tx=0x7f82f0019790 comp rx=0 tx=0).stop 2024-04-25T13:47:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82f77fe640 1 -- 172.21.15.77:0/2395531882 reap_dead start 2024-04-25T13:47:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 shutdown_connections 2024-04-25T13:47:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 >> 172.21.15.77:0/2395531882 conn(0x7f82f80a9fb0 msgr2=0x7f82f80756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 shutdown_connections 2024-04-25T13:47:14.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.377+0000 7f82fd421640 1 -- 172.21.15.77:0/2395531882 wait complete. 2024-04-25T13:47:14.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T13:47:14.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.525+0000 7effb7499640 1 Processor -- start 2024-04-25T13:47:14.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.525+0000 7effb7499640 1 -- start start 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.525+0000 7effb7499640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7effb006fba0 0x7effb014f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.525+0000 7effb7499640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7effb014fc40 0x7effb0153870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.525+0000 7effb7499640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb0153db0 0x7effb01541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.525+0000 7effb7499640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7effb0154700 con 0x7effb014fc40 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.525+0000 7effb7499640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7effb00741b0 con 0x7effb006fba0 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.525+0000 7effb7499640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7effb0071b10 con 0x7effb0153db0 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.525+0000 7effb4a34640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7effb014fc40 0x7effb0153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb4a34640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7effb014fc40 0x7effb0153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60756/0 (socket says 172.21.15.77:60756) 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb4a34640 1 -- 172.21.15.77:0/2501472787 learned_addr learned my addr 172.21.15.77:0/2501472787 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb5a36640 1 --2- 172.21.15.77:0/2501472787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb0153db0 0x7effb01541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb5235640 1 --2- 172.21.15.77:0/2501472787 >> v2:172.21.15.96:3300/0 conn(0x7effb006fba0 0x7effb014f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb4a34640 1 -- 172.21.15.77:0/2501472787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb0153db0 msgr2=0x7effb01541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb4a34640 1 --2- 172.21.15.77:0/2501472787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb0153db0 0x7effb01541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb4a34640 1 -- 172.21.15.77:0/2501472787 >> v2:172.21.15.96:3300/0 conn(0x7effb006fba0 msgr2=0x7effb014f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb4a34640 1 --2- 172.21.15.77:0/2501472787 >> v2:172.21.15.96:3300/0 conn(0x7effb006fba0 0x7effb014f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb4a34640 1 -- 172.21.15.77:0/2501472787 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb00bfe40 con 0x7effb014fc40 2024-04-25T13:47:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb5235640 1 --2- 172.21.15.77:0/2501472787 >> v2:172.21.15.96:3300/0 conn(0x7effb006fba0 0x7effb014f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:47:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb4a34640 1 --2- 172.21.15.77:0/2501472787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb014fc40 0x7effb0153870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7effb00c4620 tx=0x7effa001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca72b6af38d0c38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effa7fff640 1 -- 172.21.15.77:0/2501472787 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00b2070 con 0x7effb014fc40 2024-04-25T13:47:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effa7fff640 1 -- 172.21.15.77:0/2501472787 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa00a9070 con 0x7effb014fc40 2024-04-25T13:47:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effa7fff640 1 -- 172.21.15.77:0/2501472787 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00ad880 con 0x7effb014fc40 2024-04-25T13:47:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb7499640 1 -- 172.21.15.77:0/2501472787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb014fc40 msgr2=0x7effb0153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb7499640 1 --2- 172.21.15.77:0/2501472787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb014fc40 0x7effb0153870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7effb00c4620 tx=0x7effa001c490 comp rx=0 tx=0).stop 2024-04-25T13:47:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb7499640 1 -- 172.21.15.77:0/2501472787 shutdown_connections 2024-04-25T13:47:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb7499640 1 --2- 172.21.15.77:0/2501472787 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb0153db0 0x7effb01541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb7499640 1 --2- 172.21.15.77:0/2501472787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb014fc40 0x7effb0153870 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb7499640 1 --2- 172.21.15.77:0/2501472787 >> v2:172.21.15.96:3300/0 conn(0x7effb006fba0 0x7effb014f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb7499640 1 -- 172.21.15.77:0/2501472787 >> 172.21.15.77:0/2501472787 conn(0x7effb00c3cd0 msgr2=0x7effb00c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb7499640 1 -- 172.21.15.77:0/2501472787 shutdown_connections 2024-04-25T13:47:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.529+0000 7effb7499640 1 -- 172.21.15.77:0/2501472787 wait complete. 2024-04-25T13:47:14.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 Processor -- start 2024-04-25T13:47:14.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 -- start start 2024-04-25T13:47:14.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb006fba0 0x7effb0153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb014fc40 0x7effb014b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effb0153db0 0x7effb0151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7effb00736a0 con 0x7effb006fba0 2024-04-25T13:47:14.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7effb00a8cc0 con 0x7effb0153db0 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7effb0073820 con 0x7effb014fc40 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb5235640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb006fba0 0x7effb0153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb5235640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb006fba0 0x7effb0153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60764/0 (socket says 172.21.15.77:60764) 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb5235640 1 -- 172.21.15.77:0/3590661557 learned_addr learned my addr 172.21.15.77:0/3590661557 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb4a34640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb014fc40 0x7effb014b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb5235640 1 -- 172.21.15.77:0/3590661557 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb014fc40 msgr2=0x7effb014b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb5235640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb014fc40 0x7effb014b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb5235640 1 -- 172.21.15.77:0/3590661557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effb0153db0 msgr2=0x7effb0151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb5235640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effb0153db0 0x7effb0151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb5235640 1 -- 172.21.15.77:0/3590661557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb0153a60 con 0x7effb006fba0 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb5235640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb006fba0 0x7effb0153460 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7effac00d830 tx=0x7effac00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effa5ffb640 1 -- 172.21.15.77:0/3590661557 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac018070 con 0x7effb006fba0 2024-04-25T13:47:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effa5ffb640 1 -- 172.21.15.77:0/3590661557 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac00be10 con 0x7effb006fba0 2024-04-25T13:47:14.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb014adb0 con 0x7effb006fba0 2024-04-25T13:47:14.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effa5ffb640 1 -- 172.21.15.77:0/3590661557 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac004250 con 0x7effb006fba0 2024-04-25T13:47:14.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.533+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb0151f30 con 0x7effb006fba0 2024-04-25T13:47:14.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.537+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb006a1a0 con 0x7effb006fba0 2024-04-25T13:47:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.537+0000 7effa5ffb640 1 -- 172.21.15.77:0/3590661557 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7effac009830 con 0x7effb006fba0 2024-04-25T13:47:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.537+0000 7effa5ffb640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7eff9406f400 0x7eff94071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.537+0000 7effb4a34640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7eff9406f400 0x7eff94071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.537+0000 7effa5ffb640 1 -- 172.21.15.77:0/3590661557 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7effac08f490 con 0x7effb006fba0 2024-04-25T13:47:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.537+0000 7effb4a34640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7eff9406f400 0x7eff94071910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7effa00af000 tx=0x7effa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.541+0000 7effa5ffb640 1 -- 172.21.15.77:0/3590661557 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effac05c380 con 0x7effb006fba0 2024-04-25T13:47:14.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.693+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7effb006d5c0 con 0x7eff9406f400 2024-04-25T13:47:14.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.693+0000 7effa5ffb640 1 -- 172.21.15.77:0/3590661557 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7effb006d5c0 con 0x7eff9406f400 2024-04-25T13:47:14.696 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7eff9406f400 msgr2=0x7eff94071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7eff9406f400 0x7eff94071910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7effa00af000 tx=0x7effa0008040 comp rx=0 tx=0).stop 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb006fba0 msgr2=0x7effb0153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb006fba0 0x7effb0153460 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7effac00d830 tx=0x7effac00dcf0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 shutdown_connections 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7eff9406f400 0x7eff94071910 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effb0153db0 0x7effb0151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effb014fc40 0x7effb014b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 --2- 172.21.15.77:0/3590661557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effb006fba0 0x7effb0153460 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 >> 172.21.15.77:0/3590661557 conn(0x7effb00c3cd0 msgr2=0x7effb0150840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 shutdown_connections 2024-04-25T13:47:14.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.697+0000 7effb7499640 1 -- 172.21.15.77:0/3590661557 wait complete. 2024-04-25T13:47:14.716 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T13:47:14.716 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:47:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa67336c640 1 Processor -- start 2024-04-25T13:47:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa67336c640 1 -- start start 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa67336c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa66c0c3050 0x7fa66c0c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa67336c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66c06fc80 con 0x7fa66c0c36d0 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa67336c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66c0c0f40 con 0x7fa66c14fa20 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa67336c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa66c0c0cf0 con 0x7fa66c0c3050 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa671108640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa66c0c36d0 0x7fa66c074330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46648/0 (socket says 172.21.15.77:46648) 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa670907640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa66c0c3050 0x7fa66c0c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa671108640 1 -- 172.21.15.77:0/4214973565 learned_addr learned my addr 172.21.15.77:0/4214973565 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa663fff640 1 -- 172.21.15.77:0/4214973565 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784127749 0 0) 0x7fa66c06fc80 con 0x7fa66c0c36d0 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa663fff640 1 -- 172.21.15.77:0/4214973565 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa658003530 con 0x7fa66c0c36d0 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa670907640 1 -- 172.21.15.77:0/4214973565 >> v1:172.21.15.96:6789/0 conn(0x7fa66c14fa20 legacy=0x7fa66c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa670907640 1 -- 172.21.15.77:0/4214973565 >> v1:172.21.15.77:6789/0 conn(0x7fa66c0c36d0 legacy=0x7fa66c074330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.857+0000 7fa670907640 1 -- 172.21.15.77:0/4214973565 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c072b10 con 0x7fa66c0c3050 2024-04-25T13:47:14.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa670907640 1 --2- 172.21.15.77:0/4214973565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c3050 0x7fa66c0c1800 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0097c0 tx=0x7fa65c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c10d63f3a82d87c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa663fff640 1 -- 172.21.15.77:0/4214973565 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0b0070 con 0x7fa66c0c3050 2024-04-25T13:47:14.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa663fff640 1 -- 172.21.15.77:0/4214973565 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65c0ab600 con 0x7fa66c0c3050 2024-04-25T13:47:14.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa663fff640 1 -- 172.21.15.77:0/4214973565 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0ab9d0 con 0x7fa66c0c3050 2024-04-25T13:47:14.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa67336c640 1 -- 172.21.15.77:0/4214973565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c3050 msgr2=0x7fa66c0c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa67336c640 1 --2- 172.21.15.77:0/4214973565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c3050 0x7fa66c0c1800 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0097c0 tx=0x7fa65c01c410 comp rx=0 tx=0).stop 2024-04-25T13:47:14.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa67336c640 1 -- 172.21.15.77:0/4214973565 shutdown_connections 2024-04-25T13:47:14.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa67336c640 1 --2- 172.21.15.77:0/4214973565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c3050 0x7fa66c0c1800 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa67336c640 1 -- 172.21.15.77:0/4214973565 >> 172.21.15.77:0/4214973565 conn(0x7fa66c0a6900 msgr2=0x7fa66c0a6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:14.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa67336c640 1 -- 172.21.15.77:0/4214973565 shutdown_connections 2024-04-25T13:47:14.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa67336c640 1 -- 172.21.15.77:0/4214973565 wait complete. 2024-04-25T13:47:14.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa67336c640 1 Processor -- start 2024-04-25T13:47:14.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.861+0000 7fa67336c640 1 -- start start 2024-04-25T13:47:14.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa67336c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa66c0c3050 0x7fa66c143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa67336c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c36d0 0x7fa66c13d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa67336c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa66c14fa20 0x7fa66c14c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa67336c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c0c1d40 con 0x7fa66c0c36d0 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa67336c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c072e80 con 0x7fa66c0c3050 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa67336c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fa66c15d880 con 0x7fa66c14fa20 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa670907640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c36d0 0x7fa66c13d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa670907640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c36d0 0x7fa66c13d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60770/0 (socket says 172.21.15.77:60770) 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa670907640 1 -- 172.21.15.77:0/4292527143 learned_addr learned my addr 172.21.15.77:0/4292527143 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa671108640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa66c0c3050 0x7fa66c143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa670907640 1 -- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa66c14fa20 msgr2=0x7fa66c14c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa671909640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa66c14fa20 0x7fa66c14c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa670907640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa66c14fa20 0x7fa66c14c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa670907640 1 -- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa66c0c3050 msgr2=0x7fa66c143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa670907640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa66c0c3050 0x7fa66c143c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa670907640 1 -- 172.21.15.77:0/4292527143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c1eda60 con 0x7fa66c0c36d0 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa670907640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c36d0 0x7fa66c13d890 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa65c019020 tx=0x7fa65c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa661ffb640 1 -- 172.21.15.77:0/4292527143 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0ba070 con 0x7fa66c0c36d0 2024-04-25T13:47:14.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa661ffb640 1 -- 172.21.15.77:0/4292527143 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65c0b43f0 con 0x7fa66c0c36d0 2024-04-25T13:47:14.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa661ffb640 1 -- 172.21.15.77:0/4292527143 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0b0040 con 0x7fa66c0c36d0 2024-04-25T13:47:14.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c1ed6f0 con 0x7fa66c0c36d0 2024-04-25T13:47:14.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c1441d0 con 0x7fa66c0c36d0 2024-04-25T13:47:14.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa66c06a2f0 con 0x7fa66c0c36d0 2024-04-25T13:47:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa661ffb640 1 -- 172.21.15.77:0/4292527143 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa65c0bd070 con 0x7fa66c0c36d0 2024-04-25T13:47:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa661ffb640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa65006f400 0x7fa650071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.865+0000 7fa671108640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa65006f400 0x7fa650071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.869+0000 7fa661ffb640 1 -- 172.21.15.77:0/4292527143 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fa65c1283c0 con 0x7fa66c0c36d0 2024-04-25T13:47:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.869+0000 7fa661ffb640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7fa650077830 0x7fa650079d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.869+0000 7fa661ffb640 1 -- 172.21.15.77:0/4292527143 --> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa65c00af30 con 0x7fa650077830 2024-04-25T13:47:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.869+0000 7fa661ffb640 1 -- 172.21.15.77:0/4292527143 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa65c128850 con 0x7fa66c0c36d0 2024-04-25T13:47:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.869+0000 7fa671108640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa65006f400 0x7fa650071910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa6680011f0 tx=0x7fa668009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.869+0000 7fa671909640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7fa650077830 0x7fa650079d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:14.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.869+0000 7fa671909640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7fa650077830 0x7fa650079d20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:14.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.869+0000 7fa661ffb640 1 -- 172.21.15.77:0/4292527143 <== osd.7 v2:172.21.15.96:6811/1677667216 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa65c00af30 con 0x7fa650077830 2024-04-25T13:47:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 --> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa66c13fb40 con 0x7fa650077830 2024-04-25T13:47:14.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa661ffb640 1 -- 172.21.15.77:0/4292527143 <== osd.7 v2:172.21.15.96:6811/1677667216 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa66c13fb40 con 0x7fa650077830 2024-04-25T13:47:14.885 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T13:47:14.886 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:47:14.886 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7fa650077830 msgr2=0x7fa650079d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.96:6811/1677667216,v1:172.21.15.96:6812/1677667216] conn(0x7fa650077830 0x7fa650079d20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa65006f400 msgr2=0x7fa650071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fa65006f400 0x7fa650071910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa6680011f0 tx=0x7fa668009040 comp rx=0 tx=0).stop 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c36d0 msgr2=0x7fa66c13d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 --2- 172.21.15.77:0/4292527143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66c0c36d0 0x7fa66c13d890 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa65c019020 tx=0x7fa65c0191b0 comp rx=0 tx=0).stop 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa671909640 1 -- 172.21.15.77:0/4292527143 reap_dead start 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 shutdown_connections 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 >> 172.21.15.77:0/4292527143 conn(0x7fa66c0a6900 msgr2=0x7fa66c0c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 shutdown_connections 2024-04-25T13:47:14.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:14.885+0000 7fa67336c640 1 -- 172.21.15.77:0/4292527143 wait complete. 2024-04-25T13:47:14.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T13:47:15.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b23562640 1 Processor -- start 2024-04-25T13:47:15.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b23562640 1 -- start start 2024-04-25T13:47:15.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b23562640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b1c06fa90 0x7f0b1c14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b23562640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b1c14f2a0 con 0x7f0b1c0a8bd0 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b23562640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b1c14f580 con 0x7f0b1c14ffe0 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b23562640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1c1535a0 con 0x7f0b1c06fa90 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b212fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0b1c0a8bd0 0x7f0b1c073bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46660/0 (socket says 172.21.15.77:46660) 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b212fe640 1 -- 172.21.15.77:0/4173448439 learned_addr learned my addr 172.21.15.77:0/4173448439 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b20afd640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b1c06fa90 0x7f0b1c14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352354204 0 0) 0x7f0b1c14f2a0 con 0x7f0b1c0a8bd0 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b08003530 con 0x7f0b1c0a8bd0 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 372739367 0 0) 0x7f0b08003530 con 0x7f0b1c0a8bd0 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b1c06fa90 msgr2=0x7f0b1c14faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b1c06fa90 0x7f0b1c14faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 >> v1:172.21.15.96:6789/0 conn(0x7f0b1c14ffe0 legacy=0x7f0b1c14e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1c074560 con 0x7f0b1c0a8bd0 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f0b0c001680 con 0x7f0b1c0a8bd0 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 >> v1:172.21.15.77:6789/0 conn(0x7f0b1c0a8bd0 legacy=0x7f0b1c073bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b1c06fa90 0x7f0b08003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b08003fe0 0x7f0b08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b08004d50 0x7f0b080051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c1535a0 con 0x7f0b08003fe0 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0800bbe0 con 0x7f0b08004d50 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.041+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0800dff0 con 0x7f0b1c06fa90 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b20afd640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b08003fe0 0x7f0b08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b21aff640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b08004d50 0x7f0b080051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b20afd640 1 -- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b1c06fa90 msgr2=0x7f0b08003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b20afd640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b1c06fa90 0x7f0b08003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b20afd640 1 -- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b08004d50 msgr2=0x7f0b080051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:15.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b20afd640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b08004d50 0x7f0b080051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b20afd640 1 -- 172.21.15.77:0/4173448439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b08003530 con 0x7f0b08003fe0 2024-04-25T13:47:15.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b21aff640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b08004d50 0x7f0b080051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b20afd640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b08003fe0 0x7f0b08004810 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009ae0 tx=0x7f0b1801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d7d960a2a4e7f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180b2070 con 0x7f0b08003fe0 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b180a56a0 con 0x7f0b08003fe0 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b13fff640 1 -- 172.21.15.77:0/4173448439 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180096b0 con 0x7f0b08003fe0 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b23562640 1 -- 172.21.15.77:0/4173448439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b08003fe0 msgr2=0x7f0b08004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b23562640 1 --2- 172.21.15.77:0/4173448439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b08003fe0 0x7f0b08004810 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009ae0 tx=0x7f0b1801cab0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b21aff640 1 -- 172.21.15.77:0/4173448439 reap_dead start 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b23562640 1 -- 172.21.15.77:0/4173448439 shutdown_connections 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b23562640 1 -- 172.21.15.77:0/4173448439 >> 172.21.15.77:0/4173448439 conn(0x7f0b1c0c4ae0 msgr2=0x7f0b1c0c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b23562640 1 -- 172.21.15.77:0/4173448439 shutdown_connections 2024-04-25T13:47:15.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.045+0000 7f0b23562640 1 -- 172.21.15.77:0/4173448439 wait complete. 2024-04-25T13:47:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b23562640 1 Processor -- start 2024-04-25T13:47:15.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b23562640 1 -- start start 2024-04-25T13:47:15.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b23562640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b08003fe0 0x7f0b1c148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b23562640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c14b670 0x7f0b1c145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b23562640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b1c145f80 0x7f0b1c1474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b23562640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c14ee20 con 0x7f0b1c14b670 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b23562640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c0700b0 con 0x7f0b1c145f80 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b23562640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1c14efa0 con 0x7f0b08003fe0 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b20afd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c14b670 0x7f0b1c145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b20afd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c14b670 0x7f0b1c145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60786/0 (socket says 172.21.15.77:60786) 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b20afd640 1 -- 172.21.15.77:0/2990440109 learned_addr learned my addr 172.21.15.77:0/2990440109 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b212fe640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b08003fe0 0x7f0b1c148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b21aff640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b1c145f80 0x7f0b1c1474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b20afd640 1 -- 172.21.15.77:0/2990440109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b08003fe0 msgr2=0x7f0b1c148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b20afd640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b08003fe0 0x7f0b1c148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b20afd640 1 -- 172.21.15.77:0/2990440109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b1c145f80 msgr2=0x7f0b1c1474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b20afd640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b1c145f80 0x7f0b1c1474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b20afd640 1 -- 172.21.15.77:0/2990440109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1c1469e0 con 0x7f0b1c14b670 2024-04-25T13:47:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.049+0000 7f0b212fe640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b08003fe0 0x7f0b1c148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b20afd640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c14b670 0x7f0b1c145a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b1801c8e0 tx=0x7f0b08005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b11ffb640 1 -- 172.21.15.77:0/2990440109 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180b2040 con 0x7f0b1c14b670 2024-04-25T13:47:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b11ffb640 1 -- 172.21.15.77:0/2990440109 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b180a5e50 con 0x7f0b1c14b670 2024-04-25T13:47:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1c146cc0 con 0x7f0b1c14b670 2024-04-25T13:47:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b11ffb640 1 -- 172.21.15.77:0/2990440109 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18004020 con 0x7f0b1c14b670 2024-04-25T13:47:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1c1e8580 con 0x7f0b1c14b670 2024-04-25T13:47:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b1c06a1a0 con 0x7f0b1c14b670 2024-04-25T13:47:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b11ffb640 1 -- 172.21.15.77:0/2990440109 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0b180c0030 con 0x7f0b1c14b670 2024-04-25T13:47:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b11ffb640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b0006f400 0x7f0b00071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b212fe640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b0006f400 0x7f0b00071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b11ffb640 1 -- 172.21.15.77:0/2990440109 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f0b181299e0 con 0x7f0b1c14b670 2024-04-25T13:47:15.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.053+0000 7f0b212fe640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b0006f400 0x7f0b00071910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0017f0 tx=0x7f0b0c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:15.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.057+0000 7f0b11ffb640 1 -- 172.21.15.77:0/2990440109 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b180c7060 con 0x7f0b1c14b670 2024-04-25T13:47:15.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.213+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f0b1c0c3080 con 0x7f0b0006f400 2024-04-25T13:47:15.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b11ffb640 1 -- 172.21.15.77:0/2990440109 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0b1c0c3080 con 0x7f0b0006f400 2024-04-25T13:47:15.217 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T13:47:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b0006f400 msgr2=0x7f0b00071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b0006f400 0x7f0b00071910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0017f0 tx=0x7f0b0c00c040 comp rx=0 tx=0).stop 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c14b670 msgr2=0x7f0b1c145a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c14b670 0x7f0b1c145a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b1801c8e0 tx=0x7f0b08005840 comp rx=0 tx=0).stop 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 shutdown_connections 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f0b0006f400 0x7f0b00071910 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b1c145f80 0x7f0b1c1474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c14b670 0x7f0b1c145a40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 --2- 172.21.15.77:0/2990440109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b08003fe0 0x7f0b1c148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 >> 172.21.15.77:0/2990440109 conn(0x7f0b1c0c4ae0 msgr2=0x7f0b1c073bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 shutdown_connections 2024-04-25T13:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.217+0000 7f0b23562640 1 -- 172.21.15.77:0/2990440109 wait complete. 2024-04-25T13:47:15.238 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:47:15.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe152cd3640 1 Processor -- start 2024-04-25T13:47:15.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe152cd3640 1 -- start start 2024-04-25T13:47:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe152cd3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c14e9e0 0x7fe14c14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe152cd3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe14c0a8900 con 0x7fe14c0a5da0 2024-04-25T13:47:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe152cd3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe14c0a8ba0 con 0x7fe14c14f330 2024-04-25T13:47:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe152cd3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe14c074770 con 0x7fe14c14e9e0 2024-04-25T13:47:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe150a6f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe14c0a5da0 0x7fe14c06f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46676/0 (socket says 172.21.15.77:46676) 2024-04-25T13:47:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe150a6f640 1 -- 172.21.15.77:0/1930740804 learned_addr learned my addr 172.21.15.77:0/1930740804 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 244299205 0 0) 0x7fe14c0a8900 con 0x7fe14c0a5da0 2024-04-25T13:47:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe134003530 con 0x7fe14c0a5da0 2024-04-25T13:47:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14bfff640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c14e9e0 0x7fe14c14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 598693903 0 0) 0x7fe134003530 con 0x7fe14c0a5da0 2024-04-25T13:47:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c14e9e0 msgr2=0x7fe14c14edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c14e9e0 0x7fe14c14edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 >> v1:172.21.15.96:6789/0 conn(0x7fe14c14f330 legacy=0x7fe14c14f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c0a7c00 con 0x7fe14c0a5da0 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fe13c001820 con 0x7fe14c0a5da0 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 >> v1:172.21.15.77:6789/0 conn(0x7fe14c0a5da0 legacy=0x7fe14c06f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1340039f0 0x7fe134003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe134004810 0x7fe134004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c14e9e0 0x7fe13400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c074770 con 0x7fe1340039f0 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe1340055a0 con 0x7fe134004810 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe13400bf10 con 0x7fe14c14e9e0 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe150a6f640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1340039f0 0x7fe134003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe14bfff640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe134004810 0x7fe134004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe151270640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c14e9e0 0x7fe13400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe150a6f640 1 -- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c14e9e0 msgr2=0x7fe13400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe150a6f640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c14e9e0 0x7fe13400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe150a6f640 1 -- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe134004810 msgr2=0x7fe134004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe150a6f640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe134004810 0x7fe134004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe150a6f640 1 -- 172.21.15.77:0/1930740804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe134003530 con 0x7fe1340039f0 2024-04-25T13:47:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.373+0000 7fe151270640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c14e9e0 0x7fe13400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe150a6f640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1340039f0 0x7fe134003e60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0a8ad0 tx=0x7fe13c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea6a3faa2163f3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c007d30 con 0x7fe1340039f0 2024-04-25T13:47:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13c0a9070 con 0x7fe1340039f0 2024-04-25T13:47:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe14b7fe640 1 -- 172.21.15.77:0/1930740804 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c0074b0 con 0x7fe1340039f0 2024-04-25T13:47:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe152cd3640 1 -- 172.21.15.77:0/1930740804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1340039f0 msgr2=0x7fe134003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe152cd3640 1 --2- 172.21.15.77:0/1930740804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1340039f0 0x7fe134003e60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0a8ad0 tx=0x7fe13c01cc20 comp rx=0 tx=0).stop 2024-04-25T13:47:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe151270640 1 -- 172.21.15.77:0/1930740804 reap_dead start 2024-04-25T13:47:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe152cd3640 1 -- 172.21.15.77:0/1930740804 shutdown_connections 2024-04-25T13:47:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe152cd3640 1 -- 172.21.15.77:0/1930740804 >> 172.21.15.77:0/1930740804 conn(0x7fe14c0c02a0 msgr2=0x7fe14c0c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe152cd3640 1 -- 172.21.15.77:0/1930740804 shutdown_connections 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.377+0000 7fe152cd3640 1 -- 172.21.15.77:0/1930740804 wait complete. 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 Processor -- start 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 -- start start 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340039f0 0x7fe14c152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c150fd0 0x7fe14c1ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe14c1ed5a0 0x7fe14c0b8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c15b600 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c15b480 con 0x7fe1340039f0 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe14c15b780 con 0x7fe14c150fd0 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe151270640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe14c1ed5a0 0x7fe14c0b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe151270640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe14c1ed5a0 0x7fe14c0b8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60808/0 (socket says 172.21.15.77:60808) 2024-04-25T13:47:15.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe151270640 1 -- 172.21.15.77:0/2034606894 learned_addr learned my addr 172.21.15.77:0/2034606894 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe14bfff640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c150fd0 0x7fe14c1ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe150a6f640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340039f0 0x7fe14c152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe151270640 1 -- 172.21.15.77:0/2034606894 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c150fd0 msgr2=0x7fe14c1ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe151270640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c150fd0 0x7fe14c1ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe151270640 1 -- 172.21.15.77:0/2034606894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340039f0 msgr2=0x7fe14c152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe151270640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340039f0 0x7fe14c152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe151270640 1 -- 172.21.15.77:0/2034606894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c148e70 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe151270640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe14c1ed5a0 0x7fe14c0b8960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe14c070470 tx=0x7fe14400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe1497fa640 1 -- 172.21.15.77:0/2034606894 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144006d60 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe1497fa640 1 -- 172.21.15.77:0/2034606894 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe144003980 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c0ba590 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe1497fa640 1 -- 172.21.15.77:0/2034606894 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144003d70 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c1514f0 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.381+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14c151750 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.385+0000 7fe1497fa640 1 -- 172.21.15.77:0/2034606894 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe14401b020 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.385+0000 7fe1497fa640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe13806f400 0x7fe138071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:15.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.385+0000 7fe1497fa640 1 -- 172.21.15.77:0/2034606894 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe14408f680 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.385+0000 7fe150a6f640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe13806f400 0x7fe138071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:15.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.385+0000 7fe150a6f640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe13806f400 0x7fe138071910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0ab000 tx=0x7fe13c0b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:15.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.389+0000 7fe1497fa640 1 -- 172.21.15.77:0/2034606894 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe144022070 con 0x7fe14c1ed5a0 2024-04-25T13:47:15.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.533+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe14c06a280 con 0x7fe13806f400 2024-04-25T13:47:15.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.541+0000 7fe1497fa640 1 -- 172.21.15.77:0/2034606894 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252175 (secure 0 0 0) 0x7fe13c0fb920 con 0x7fe13806f400 2024-04-25T13:47:15.545 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:15.547 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T13:47:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe13806f400 msgr2=0x7fe138071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe13806f400 0x7fe138071910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0ab000 tx=0x7fe13c0b1040 comp rx=0 tx=0).stop 2024-04-25T13:47:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe14c1ed5a0 msgr2=0x7fe14c0b8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe14c1ed5a0 0x7fe14c0b8960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe14c070470 tx=0x7fe14400dc00 comp rx=0 tx=0).stop 2024-04-25T13:47:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 shutdown_connections 2024-04-25T13:47:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe13806f400 0x7fe138071910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe14c1ed5a0 0x7fe14c0b8960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe14c150fd0 0x7fe14c1ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 --2- 172.21.15.77:0/2034606894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1340039f0 0x7fe14c152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 >> 172.21.15.77:0/2034606894 conn(0x7fe14c0c02a0 msgr2=0x7fe14c158140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 shutdown_connections 2024-04-25T13:47:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:15.545+0000 7fe152cd3640 1 -- 172.21.15.77:0/2034606894 wait complete. 2024-04-25T13:47:15.565 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-04-25T13:47:14.514701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76265210,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":371,"num_read_kb":1008,"num_write":10993,"num_write_kb":81620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19805,"ondisk_log_size":19805,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":505072,"kb_used_data":112688,"kb_used_omap":12,"kb_used_meta":392307,"kb_avail":754469648,"statfs":{"total":773094113280,"available":772576919552,"internally_reserved":0,"allocated":115392512,"data_stored":153233412,"data_compressed":10406040,"data_compressed_allocated":20234240,"data_compressed_original":59367424,"omap_allocated":12752,"internal_metadata":401722928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004851"},"pg_stats":[{"pgid":"3.3f","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.711440+0000","last_change":"2024-04-25T13:41:04.470225+0000","last_active":"2024-04-25T13:47:01.711440+0000","last_peered":"2024-04-25T13:47:01.711440+0000","last_clean":"2024-04-25T13:47:01.711440+0000","last_became_active":"2024-04-25T13:41:04.434108+0000","last_became_peered":"2024-04-25T13:41:04.434108+0000","last_unstale":"2024-04-25T13:47:01.711440+0000","last_undegraded":"2024-04-25T13:47:01.711440+0000","last_fullsized":"2024-04-25T13:47:01.711440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'80","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.694562+0000","last_change":"2024-04-25T13:41:04.422886+0000","last_active":"2024-04-25T13:47:01.694562+0000","last_peered":"2024-04-25T13:47:01.694562+0000","last_clean":"2024-04-25T13:47:01.694562+0000","last_became_active":"2024-04-25T13:41:04.422546+0000","last_became_peered":"2024-04-25T13:41:04.422546+0000","last_unstale":"2024-04-25T13:47:01.694562+0000","last_undegraded":"2024-04-25T13:47:01.694562+0000","last_fullsized":"2024-04-25T13:47:01.694562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'65","reported_seq":84,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702470+0000","last_change":"2024-04-25T13:41:04.413021+0000","last_active":"2024-04-25T13:47:01.702470+0000","last_peered":"2024-04-25T13:47:01.702470+0000","last_clean":"2024-04-25T13:47:01.702470+0000","last_became_active":"2024-04-25T13:41:04.412382+0000","last_became_peered":"2024-04-25T13:41:04.412382+0000","last_unstale":"2024-04-25T13:47:01.702470+0000","last_undegraded":"2024-04-25T13:47:01.702470+0000","last_fullsized":"2024-04-25T13:47:01.702470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706143+0000","last_change":"2024-04-25T13:41:04.419756+0000","last_active":"2024-04-25T13:47:01.706143+0000","last_peered":"2024-04-25T13:47:01.706143+0000","last_clean":"2024-04-25T13:47:01.706143+0000","last_became_active":"2024-04-25T13:41:04.418367+0000","last_became_peered":"2024-04-25T13:41:04.418367+0000","last_unstale":"2024-04-25T13:47:01.706143+0000","last_undegraded":"2024-04-25T13:47:01.706143+0000","last_fullsized":"2024-04-25T13:47:01.706143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'85","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706761+0000","last_change":"2024-04-25T13:41:04.428788+0000","last_active":"2024-04-25T13:47:01.706761+0000","last_peered":"2024-04-25T13:47:01.706761+0000","last_clean":"2024-04-25T13:47:01.706761+0000","last_became_active":"2024-04-25T13:41:04.428424+0000","last_became_peered":"2024-04-25T13:41:04.428424+0000","last_unstale":"2024-04-25T13:47:01.706761+0000","last_undegraded":"2024-04-25T13:47:01.706761+0000","last_fullsized":"2024-04-25T13:47:01.706761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695923+0000","last_change":"2024-04-25T13:41:04.432387+0000","last_active":"2024-04-25T13:47:01.695923+0000","last_peered":"2024-04-25T13:47:01.695923+0000","last_clean":"2024-04-25T13:47:01.695923+0000","last_became_active":"2024-04-25T13:41:04.431971+0000","last_became_peered":"2024-04-25T13:41:04.431971+0000","last_unstale":"2024-04-25T13:47:01.695923+0000","last_undegraded":"2024-04-25T13:47:01.695923+0000","last_fullsized":"2024-04-25T13:47:01.695923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'93","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.712245+0000","last_change":"2024-04-25T13:41:04.473786+0000","last_active":"2024-04-25T13:47:01.712245+0000","last_peered":"2024-04-25T13:47:01.712245+0000","last_clean":"2024-04-25T13:47:01.712245+0000","last_became_active":"2024-04-25T13:41:04.471082+0000","last_became_peered":"2024-04-25T13:41:04.471082+0000","last_unstale":"2024-04-25T13:47:01.712245+0000","last_undegraded":"2024-04-25T13:47:01.712245+0000","last_fullsized":"2024-04-25T13:47:01.712245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.693577+0000","last_change":"2024-04-25T13:41:04.410956+0000","last_active":"2024-04-25T13:47:01.693577+0000","last_peered":"2024-04-25T13:47:01.693577+0000","last_clean":"2024-04-25T13:47:01.693577+0000","last_became_active":"2024-04-25T13:41:04.410665+0000","last_became_peered":"2024-04-25T13:41:04.410665+0000","last_unstale":"2024-04-25T13:47:01.693577+0000","last_undegraded":"2024-04-25T13:47:01.693577+0000","last_fullsized":"2024-04-25T13:47:01.693577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'89","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.709375+0000","last_change":"2024-04-25T13:41:04.470410+0000","last_active":"2024-04-25T13:47:01.709375+0000","last_peered":"2024-04-25T13:47:01.709375+0000","last_clean":"2024-04-25T13:47:01.709375+0000","last_became_active":"2024-04-25T13:41:04.434676+0000","last_became_peered":"2024-04-25T13:41:04.434676+0000","last_unstale":"2024-04-25T13:47:01.709375+0000","last_undegraded":"2024-04-25T13:47:01.709375+0000","last_fullsized":"2024-04-25T13:47:01.709375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'73","reported_seq":90,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689356+0000","last_change":"2024-04-25T13:41:04.417498+0000","last_active":"2024-04-25T13:47:01.689356+0000","last_peered":"2024-04-25T13:47:01.689356+0000","last_clean":"2024-04-25T13:47:01.689356+0000","last_became_active":"2024-04-25T13:41:04.417145+0000","last_became_peered":"2024-04-25T13:41:04.417145+0000","last_unstale":"2024-04-25T13:47:01.689356+0000","last_undegraded":"2024-04-25T13:47:01.689356+0000","last_fullsized":"2024-04-25T13:47:01.689356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'79","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.642001+0000","last_change":"2024-04-25T13:41:04.417324+0000","last_active":"2024-04-25T13:47:01.642001+0000","last_peered":"2024-04-25T13:47:01.642001+0000","last_clean":"2024-04-25T13:47:01.642001+0000","last_became_active":"2024-04-25T13:41:04.416982+0000","last_became_peered":"2024-04-25T13:41:04.416982+0000","last_unstale":"2024-04-25T13:47:01.642001+0000","last_undegraded":"2024-04-25T13:47:01.642001+0000","last_fullsized":"2024-04-25T13:47:01.642001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689067+0000","last_change":"2024-04-25T13:41:04.412869+0000","last_active":"2024-04-25T13:47:01.689067+0000","last_peered":"2024-04-25T13:47:01.689067+0000","last_clean":"2024-04-25T13:47:01.689067+0000","last_became_active":"2024-04-25T13:41:04.412544+0000","last_became_peered":"2024-04-25T13:41:04.412544+0000","last_unstale":"2024-04-25T13:47:01.689067+0000","last_undegraded":"2024-04-25T13:47:01.689067+0000","last_fullsized":"2024-04-25T13:47:01.689067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.706961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'84","reported_seq":102,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.694600+0000","last_change":"2024-04-25T13:41:04.412143+0000","last_active":"2024-04-25T13:47:01.694600+0000","last_peered":"2024-04-25T13:47:01.694600+0000","last_clean":"2024-04-25T13:47:01.694600+0000","last_became_active":"2024-04-25T13:41:04.411840+0000","last_became_peered":"2024-04-25T13:41:04.411840+0000","last_unstale":"2024-04-25T13:47:01.694600+0000","last_undegraded":"2024-04-25T13:47:01.694600+0000","last_fullsized":"2024-04-25T13:47:01.694600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'74","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705233+0000","last_change":"2024-04-25T13:41:04.426859+0000","last_active":"2024-04-25T13:47:01.705233+0000","last_peered":"2024-04-25T13:47:01.705233+0000","last_clean":"2024-04-25T13:47:01.705233+0000","last_became_active":"2024-04-25T13:41:04.426437+0000","last_became_peered":"2024-04-25T13:41:04.426437+0000","last_unstale":"2024-04-25T13:47:01.705233+0000","last_undegraded":"2024-04-25T13:47:01.705233+0000","last_fullsized":"2024-04-25T13:47:01.705233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'78","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.709223+0000","last_change":"2024-04-25T13:41:04.410712+0000","last_active":"2024-04-25T13:47:01.709223+0000","last_peered":"2024-04-25T13:47:01.709223+0000","last_clean":"2024-04-25T13:47:01.709223+0000","last_became_active":"2024-04-25T13:41:04.410362+0000","last_became_peered":"2024-04-25T13:41:04.410362+0000","last_unstale":"2024-04-25T13:47:01.709223+0000","last_undegraded":"2024-04-25T13:47:01.709223+0000","last_fullsized":"2024-04-25T13:47:01.709223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.697238+0000","last_change":"2024-04-25T13:41:04.429493+0000","last_active":"2024-04-25T13:47:01.697238+0000","last_peered":"2024-04-25T13:47:01.697238+0000","last_clean":"2024-04-25T13:47:01.697238+0000","last_became_active":"2024-04-25T13:41:04.429116+0000","last_became_peered":"2024-04-25T13:41:04.429116+0000","last_unstale":"2024-04-25T13:47:01.697238+0000","last_undegraded":"2024-04-25T13:47:01.697238+0000","last_fullsized":"2024-04-25T13:47:01.697238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'80","reported_seq":98,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702423+0000","last_change":"2024-04-25T13:41:04.431688+0000","last_active":"2024-04-25T13:47:01.702423+0000","last_peered":"2024-04-25T13:47:01.702423+0000","last_clean":"2024-04-25T13:47:01.702423+0000","last_became_active":"2024-04-25T13:41:04.431231+0000","last_became_peered":"2024-04-25T13:41:04.431231+0000","last_unstale":"2024-04-25T13:47:01.702423+0000","last_undegraded":"2024-04-25T13:47:01.702423+0000","last_fullsized":"2024-04-25T13:47:01.702423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'76","reported_seq":94,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.632423+0000","last_change":"2024-04-25T13:41:04.407914+0000","last_active":"2024-04-25T13:47:01.632423+0000","last_peered":"2024-04-25T13:47:01.632423+0000","last_clean":"2024-04-25T13:47:01.632423+0000","last_became_active":"2024-04-25T13:41:04.407553+0000","last_became_peered":"2024-04-25T13:41:04.407553+0000","last_unstale":"2024-04-25T13:47:01.632423+0000","last_undegraded":"2024-04-25T13:47:01.632423+0000","last_fullsized":"2024-04-25T13:47:01.632423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706072+0000","last_change":"2024-04-25T13:41:04.430301+0000","last_active":"2024-04-25T13:47:01.706072+0000","last_peered":"2024-04-25T13:47:01.706072+0000","last_clean":"2024-04-25T13:47:01.706072+0000","last_became_active":"2024-04-25T13:41:04.428597+0000","last_became_peered":"2024-04-25T13:41:04.428597+0000","last_unstale":"2024-04-25T13:47:01.706072+0000","last_undegraded":"2024-04-25T13:47:01.706072+0000","last_fullsized":"2024-04-25T13:47:01.706072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'82","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.684496+0000","last_change":"2024-04-25T13:41:04.423772+0000","last_active":"2024-04-25T13:47:01.684496+0000","last_peered":"2024-04-25T13:47:01.684496+0000","last_clean":"2024-04-25T13:47:01.684496+0000","last_became_active":"2024-04-25T13:41:04.423453+0000","last_became_peered":"2024-04-25T13:41:04.423453+0000","last_unstale":"2024-04-25T13:47:01.684496+0000","last_undegraded":"2024-04-25T13:47:01.684496+0000","last_fullsized":"2024-04-25T13:47:01.684496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:43.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'83","reported_seq":102,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.701987+0000","last_change":"2024-04-25T13:41:04.430195+0000","last_active":"2024-04-25T13:47:01.701987+0000","last_peered":"2024-04-25T13:47:01.701987+0000","last_clean":"2024-04-25T13:47:01.701987+0000","last_became_active":"2024-04-25T13:41:04.429917+0000","last_became_peered":"2024-04-25T13:41:04.429917+0000","last_unstale":"2024-04-25T13:47:01.701987+0000","last_undegraded":"2024-04-25T13:47:01.701987+0000","last_fullsized":"2024-04-25T13:47:01.701987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'88","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692652+0000","last_change":"2024-04-25T13:41:04.431579+0000","last_active":"2024-04-25T13:47:01.692652+0000","last_peered":"2024-04-25T13:47:01.692652+0000","last_clean":"2024-04-25T13:47:01.692652+0000","last_became_active":"2024-04-25T13:41:04.431160+0000","last_became_peered":"2024-04-25T13:41:04.431160+0000","last_unstale":"2024-04-25T13:47:01.692652+0000","last_undegraded":"2024-04-25T13:47:01.692652+0000","last_fullsized":"2024-04-25T13:47:01.692652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'69","reported_seq":87,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698369+0000","last_change":"2024-04-25T13:41:04.423185+0000","last_active":"2024-04-25T13:47:01.698369+0000","last_peered":"2024-04-25T13:47:01.698369+0000","last_clean":"2024-04-25T13:47:01.698369+0000","last_became_active":"2024-04-25T13:41:04.422815+0000","last_became_peered":"2024-04-25T13:41:04.422815+0000","last_unstale":"2024-04-25T13:47:01.698369+0000","last_undegraded":"2024-04-25T13:47:01.698369+0000","last_fullsized":"2024-04-25T13:47:01.698369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:14.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698911+0000","last_change":"2024-04-25T13:41:04.415522+0000","last_active":"2024-04-25T13:47:01.698911+0000","last_peered":"2024-04-25T13:47:01.698911+0000","last_clean":"2024-04-25T13:47:01.698911+0000","last_became_active":"2024-04-25T13:41:04.414898+0000","last_became_peered":"2024-04-25T13:41:04.414898+0000","last_unstale":"2024-04-25T13:47:01.698911+0000","last_undegraded":"2024-04-25T13:47:01.698911+0000","last_fullsized":"2024-04-25T13:47:01.698911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'91","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.698454+0000","last_change":"2024-04-25T13:41:04.422142+0000","last_active":"2024-04-25T13:47:01.698454+0000","last_peered":"2024-04-25T13:47:01.698454+0000","last_clean":"2024-04-25T13:47:01.698454+0000","last_became_active":"2024-04-25T13:41:04.421279+0000","last_became_peered":"2024-04-25T13:41:04.421279+0000","last_unstale":"2024-04-25T13:47:01.698454+0000","last_undegraded":"2024-04-25T13:47:01.698454+0000","last_fullsized":"2024-04-25T13:47:01.698454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'98","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.690874+0000","last_change":"2024-04-25T13:41:04.431595+0000","last_active":"2024-04-25T13:47:01.690874+0000","last_peered":"2024-04-25T13:47:01.690874+0000","last_clean":"2024-04-25T13:47:01.690874+0000","last_became_active":"2024-04-25T13:41:04.431130+0000","last_became_peered":"2024-04-25T13:41:04.431130+0000","last_unstale":"2024-04-25T13:47:01.690874+0000","last_undegraded":"2024-04-25T13:47:01.690874+0000","last_fullsized":"2024-04-25T13:47:01.690874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'80","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.699465+0000","last_change":"2024-04-25T13:41:04.413732+0000","last_active":"2024-04-25T13:47:01.699465+0000","last_peered":"2024-04-25T13:47:01.699465+0000","last_clean":"2024-04-25T13:47:01.699465+0000","last_became_active":"2024-04-25T13:41:04.413001+0000","last_became_peered":"2024-04-25T13:41:04.413001+0000","last_unstale":"2024-04-25T13:47:01.699465+0000","last_undegraded":"2024-04-25T13:47:01.699465+0000","last_fullsized":"2024-04-25T13:47:01.699465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'61","reported_seq":73,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.676704+0000","last_change":"2024-04-25T13:41:51.580003+0000","last_active":"2024-04-25T13:47:01.676704+0000","last_peered":"2024-04-25T13:47:01.676704+0000","last_clean":"2024-04-25T13:47:01.676704+0000","last_became_active":"2024-04-25T13:41:51.578959+0000","last_became_peered":"2024-04-25T13:41:51.578959+0000","last_unstale":"2024-04-25T13:47:01.676704+0000","last_undegraded":"2024-04-25T13:47:01.676704+0000","last_fullsized":"2024-04-25T13:47:01.676704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:19.847652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"23'87","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704822+0000","last_change":"2024-04-25T13:41:04.423204+0000","last_active":"2024-04-25T13:47:01.704822+0000","last_peered":"2024-04-25T13:47:01.704822+0000","last_clean":"2024-04-25T13:47:01.704822+0000","last_became_active":"2024-04-25T13:41:04.422855+0000","last_became_peered":"2024-04-25T13:41:04.422855+0000","last_unstale":"2024-04-25T13:47:01.704822+0000","last_undegraded":"2024-04-25T13:47:01.704822+0000","last_fullsized":"2024-04-25T13:47:01.704822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'82","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707704+0000","last_change":"2024-04-25T13:41:04.416506+0000","last_active":"2024-04-25T13:47:01.707704+0000","last_peered":"2024-04-25T13:47:01.707704+0000","last_clean":"2024-04-25T13:47:01.707704+0000","last_became_active":"2024-04-25T13:41:04.416177+0000","last_became_peered":"2024-04-25T13:41:04.416177+0000","last_unstale":"2024-04-25T13:47:01.707704+0000","last_undegraded":"2024-04-25T13:47:01.707704+0000","last_fullsized":"2024-04-25T13:47:01.707704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'92","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705522+0000","last_change":"2024-04-25T13:41:51.963280+0000","last_active":"2024-04-25T13:47:01.705522+0000","last_peered":"2024-04-25T13:47:01.705522+0000","last_clean":"2024-04-25T13:47:01.705522+0000","last_became_active":"2024-04-25T13:41:51.962421+0000","last_became_peered":"2024-04-25T13:41:51.962421+0000","last_unstale":"2024-04-25T13:47:01.705522+0000","last_undegraded":"2024-04-25T13:47:01.705522+0000","last_fullsized":"2024-04-25T13:47:01.705522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'82","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695679+0000","last_change":"2024-04-25T13:41:04.430078+0000","last_active":"2024-04-25T13:47:01.695679+0000","last_peered":"2024-04-25T13:47:01.695679+0000","last_clean":"2024-04-25T13:47:01.695679+0000","last_became_active":"2024-04-25T13:41:04.429518+0000","last_became_peered":"2024-04-25T13:41:04.429518+0000","last_unstale":"2024-04-25T13:47:01.695679+0000","last_undegraded":"2024-04-25T13:47:01.695679+0000","last_fullsized":"2024-04-25T13:47:01.695679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:29.403996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'99","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.673373+0000","last_change":"2024-04-25T13:41:04.402158+0000","last_active":"2024-04-25T13:47:01.673373+0000","last_peered":"2024-04-25T13:47:01.673373+0000","last_clean":"2024-04-25T13:47:01.673373+0000","last_became_active":"2024-04-25T13:41:04.401821+0000","last_became_peered":"2024-04-25T13:41:04.401821+0000","last_unstale":"2024-04-25T13:47:01.673373+0000","last_undegraded":"2024-04-25T13:47:01.673373+0000","last_fullsized":"2024-04-25T13:47:01.673373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:18.457935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'881","reported_seq":901,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.561591+0000","last_change":"2024-04-25T13:41:03.425690+0000","last_active":"2024-04-25T13:46:38.561591+0000","last_peered":"2024-04-25T13:46:38.561591+0000","last_clean":"2024-04-25T13:46:38.561591+0000","last_became_active":"2024-04-25T13:41:03.425239+0000","last_became_peered":"2024-04-25T13:41:03.425239+0000","last_unstale":"2024-04-25T13:46:38.561591+0000","last_undegraded":"2024-04-25T13:46:38.561591+0000","last_fullsized":"2024-04-25T13:46:38.561591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'78","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705401+0000","last_change":"2024-04-25T13:41:04.411250+0000","last_active":"2024-04-25T13:47:01.705401+0000","last_peered":"2024-04-25T13:47:01.705401+0000","last_clean":"2024-04-25T13:47:01.705401+0000","last_became_active":"2024-04-25T13:41:04.400223+0000","last_became_peered":"2024-04-25T13:41:04.400223+0000","last_unstale":"2024-04-25T13:47:01.705401+0000","last_undegraded":"2024-04-25T13:47:01.705401+0000","last_fullsized":"2024-04-25T13:47:01.705401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'462","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.568394+0000","last_change":"2024-04-25T13:41:03.435467+0000","last_active":"2024-04-25T13:46:38.568394+0000","last_peered":"2024-04-25T13:46:38.568394+0000","last_clean":"2024-04-25T13:46:38.568394+0000","last_became_active":"2024-04-25T13:41:03.426677+0000","last_became_peered":"2024-04-25T13:41:03.426677+0000","last_unstale":"2024-04-25T13:46:38.568394+0000","last_undegraded":"2024-04-25T13:46:38.568394+0000","last_fullsized":"2024-04-25T13:46:38.568394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":4234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'118","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.118271+0000","last_change":"2024-04-25T13:41:03.437180+0000","last_active":"2024-04-25T13:45:30.118271+0000","last_peered":"2024-04-25T13:45:30.118271+0000","last_clean":"2024-04-25T13:45:30.118271+0000","last_became_active":"2024-04-25T13:41:03.436905+0000","last_became_peered":"2024-04-25T13:41:03.436905+0000","last_unstale":"2024-04-25T13:45:30.118271+0000","last_undegraded":"2024-04-25T13:45:30.118271+0000","last_fullsized":"2024-04-25T13:45:30.118271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706538+0000","last_change":"2024-04-25T13:41:04.423777+0000","last_active":"2024-04-25T13:47:01.706538+0000","last_peered":"2024-04-25T13:47:01.706538+0000","last_clean":"2024-04-25T13:47:01.706538+0000","last_became_active":"2024-04-25T13:41:04.423470+0000","last_became_peered":"2024-04-25T13:41:04.423470+0000","last_unstale":"2024-04-25T13:47:01.706538+0000","last_undegraded":"2024-04-25T13:47:01.706538+0000","last_fullsized":"2024-04-25T13:47:01.706538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:39.677391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'1580","reported_seq":1600,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.604698+0000","last_change":"2024-04-25T13:41:03.445205+0000","last_active":"2024-04-25T13:47:01.604698+0000","last_peered":"2024-04-25T13:47:01.604698+0000","last_clean":"2024-04-25T13:47:01.604698+0000","last_became_active":"2024-04-25T13:41:03.444412+0000","last_became_peered":"2024-04-25T13:41:03.444412+0000","last_unstale":"2024-04-25T13:47:01.604698+0000","last_undegraded":"2024-04-25T13:47:01.604698+0000","last_fullsized":"2024-04-25T13:47:01.604698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1580,"log_dups_size":0,"ondisk_log_size":1580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7794585,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1453,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'89","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704777+0000","last_change":"2024-04-25T13:41:04.413827+0000","last_active":"2024-04-25T13:47:01.704777+0000","last_peered":"2024-04-25T13:47:01.704777+0000","last_clean":"2024-04-25T13:47:01.704777+0000","last_became_active":"2024-04-25T13:41:04.413496+0000","last_became_peered":"2024-04-25T13:41:04.413496+0000","last_unstale":"2024-04-25T13:47:01.704777+0000","last_undegraded":"2024-04-25T13:47:01.704777+0000","last_fullsized":"2024-04-25T13:47:01.704777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'122","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.558831+0000","last_change":"2024-04-25T13:41:03.450428+0000","last_active":"2024-04-25T13:46:38.558831+0000","last_peered":"2024-04-25T13:46:38.558831+0000","last_clean":"2024-04-25T13:46:38.558831+0000","last_became_active":"2024-04-25T13:41:03.449629+0000","last_became_peered":"2024-04-25T13:41:03.449629+0000","last_unstale":"2024-04-25T13:46:38.558831+0000","last_undegraded":"2024-04-25T13:46:38.558831+0000","last_fullsized":"2024-04-25T13:46:38.558831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'92","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705851+0000","last_change":"2024-04-25T13:41:51.584948+0000","last_active":"2024-04-25T13:47:01.705851+0000","last_peered":"2024-04-25T13:47:01.705851+0000","last_clean":"2024-04-25T13:47:01.705851+0000","last_became_active":"2024-04-25T13:41:51.584089+0000","last_became_peered":"2024-04-25T13:41:51.584089+0000","last_unstale":"2024-04-25T13:47:01.705851+0000","last_undegraded":"2024-04-25T13:47:01.705851+0000","last_fullsized":"2024-04-25T13:47:01.705851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:55.294598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'135","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.558766+0000","last_change":"2024-04-25T13:41:03.445209+0000","last_active":"2024-04-25T13:46:38.558766+0000","last_peered":"2024-04-25T13:46:38.558766+0000","last_clean":"2024-04-25T13:46:38.558766+0000","last_became_active":"2024-04-25T13:41:03.444460+0000","last_became_peered":"2024-04-25T13:41:03.444460+0000","last_unstale":"2024-04-25T13:46:38.558766+0000","last_undegraded":"2024-04-25T13:46:38.558766+0000","last_fullsized":"2024-04-25T13:46:38.558766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'80","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702842+0000","last_change":"2024-04-25T13:41:04.423661+0000","last_active":"2024-04-25T13:47:01.702842+0000","last_peered":"2024-04-25T13:47:01.702842+0000","last_clean":"2024-04-25T13:47:01.702842+0000","last_became_active":"2024-04-25T13:41:04.421991+0000","last_became_peered":"2024-04-25T13:41:04.421991+0000","last_unstale":"2024-04-25T13:47:01.702842+0000","last_undegraded":"2024-04-25T13:47:01.702842+0000","last_fullsized":"2024-04-25T13:47:01.702842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'242","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.563757+0000","last_change":"2024-04-25T13:41:03.443960+0000","last_active":"2024-04-25T13:46:39.563757+0000","last_peered":"2024-04-25T13:46:39.563757+0000","last_clean":"2024-04-25T13:46:39.563757+0000","last_became_active":"2024-04-25T13:41:03.443721+0000","last_became_peered":"2024-04-25T13:41:03.443721+0000","last_unstale":"2024-04-25T13:46:39.563757+0000","last_undegraded":"2024-04-25T13:46:39.563757+0000","last_fullsized":"2024-04-25T13:46:39.563757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700376+0000","last_change":"2024-04-25T13:41:04.423896+0000","last_active":"2024-04-25T13:47:01.700376+0000","last_peered":"2024-04-25T13:47:01.700376+0000","last_clean":"2024-04-25T13:47:01.700376+0000","last_became_active":"2024-04-25T13:41:04.423569+0000","last_became_peered":"2024-04-25T13:41:04.423569+0000","last_unstale":"2024-04-25T13:47:01.700376+0000","last_undegraded":"2024-04-25T13:47:01.700376+0000","last_fullsized":"2024-04-25T13:47:01.700376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:24.346356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'558","reported_seq":577,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.569179+0000","last_change":"2024-04-25T13:41:03.426055+0000","last_active":"2024-04-25T13:46:38.569179+0000","last_peered":"2024-04-25T13:46:38.569179+0000","last_clean":"2024-04-25T13:46:38.569179+0000","last_became_active":"2024-04-25T13:41:03.424990+0000","last_became_peered":"2024-04-25T13:41:03.424990+0000","last_unstale":"2024-04-25T13:46:38.569179+0000","last_undegraded":"2024-04-25T13:46:38.569179+0000","last_fullsized":"2024-04-25T13:46:38.569179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'65","reported_seq":83,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.700984+0000","last_change":"2024-04-25T13:41:04.430564+0000","last_active":"2024-04-25T13:47:01.700984+0000","last_peered":"2024-04-25T13:47:01.700984+0000","last_clean":"2024-04-25T13:47:01.700984+0000","last_became_active":"2024-04-25T13:41:04.427802+0000","last_became_peered":"2024-04-25T13:41:04.427802+0000","last_unstale":"2024-04-25T13:47:01.700984+0000","last_undegraded":"2024-04-25T13:47:01.700984+0000","last_fullsized":"2024-04-25T13:47:01.700984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'1525","reported_seq":1550,"reported_epoch":23,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-25T13:47:12.442557+0000","last_change":"2024-04-25T13:47:12.442122+0000","last_active":"2024-04-25T13:47:12.442557+0000","last_peered":"2024-04-25T13:47:12.442557+0000","last_clean":"2024-04-25T13:47:12.442557+0000","last_became_active":"2024-04-25T13:41:03.422529+0000","last_became_peered":"2024-04-25T13:41:03.422529+0000","last_unstale":"2024-04-25T13:47:12.442557+0000","last_undegraded":"2024-04-25T13:47:12.442557+0000","last_fullsized":"2024-04-25T13:47:12.442557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1414,"num_write_kb":8966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'80","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.689930+0000","last_change":"2024-04-25T13:41:04.429077+0000","last_active":"2024-04-25T13:47:01.689930+0000","last_peered":"2024-04-25T13:47:01.689930+0000","last_clean":"2024-04-25T13:47:01.689930+0000","last_became_active":"2024-04-25T13:41:04.428641+0000","last_became_peered":"2024-04-25T13:41:04.428641+0000","last_unstale":"2024-04-25T13:47:01.689930+0000","last_undegraded":"2024-04-25T13:47:01.689930+0000","last_fullsized":"2024-04-25T13:47:01.689930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'125","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.555214+0000","last_change":"2024-04-25T13:41:03.450649+0000","last_active":"2024-04-25T13:46:39.555214+0000","last_peered":"2024-04-25T13:46:39.555214+0000","last_clean":"2024-04-25T13:46:39.555214+0000","last_became_active":"2024-04-25T13:41:03.449872+0000","last_became_peered":"2024-04-25T13:41:03.449872+0000","last_unstale":"2024-04-25T13:46:39.555214+0000","last_undegraded":"2024-04-25T13:46:39.555214+0000","last_fullsized":"2024-04-25T13:46:39.555214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'85","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.677702+0000","last_change":"2024-04-25T13:41:51.580092+0000","last_active":"2024-04-25T13:47:01.677702+0000","last_peered":"2024-04-25T13:47:01.677702+0000","last_clean":"2024-04-25T13:47:01.677702+0000","last_became_active":"2024-04-25T13:41:51.578950+0000","last_became_peered":"2024-04-25T13:41:51.578950+0000","last_unstale":"2024-04-25T13:47:01.677702+0000","last_undegraded":"2024-04-25T13:47:01.677702+0000","last_fullsized":"2024-04-25T13:47:01.677702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"23'124","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:42.457078+0000","last_change":"2024-04-25T13:41:03.423826+0000","last_active":"2024-04-25T13:45:42.457078+0000","last_peered":"2024-04-25T13:45:42.457078+0000","last_clean":"2024-04-25T13:45:42.457078+0000","last_became_active":"2024-04-25T13:41:03.423037+0000","last_became_peered":"2024-04-25T13:41:03.423037+0000","last_unstale":"2024-04-25T13:45:42.457078+0000","last_undegraded":"2024-04-25T13:45:42.457078+0000","last_fullsized":"2024-04-25T13:45:42.457078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'91","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.695393+0000","last_change":"2024-04-25T13:41:04.429831+0000","last_active":"2024-04-25T13:47:01.695393+0000","last_peered":"2024-04-25T13:47:01.695393+0000","last_clean":"2024-04-25T13:47:01.695393+0000","last_became_active":"2024-04-25T13:41:04.429110+0000","last_became_peered":"2024-04-25T13:41:04.429110+0000","last_unstale":"2024-04-25T13:47:01.695393+0000","last_undegraded":"2024-04-25T13:47:01.695393+0000","last_fullsized":"2024-04-25T13:47:01.695393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:37.774613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'134","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:42.452354+0000","last_change":"2024-04-25T13:41:03.409148+0000","last_active":"2024-04-25T13:45:42.452354+0000","last_peered":"2024-04-25T13:45:42.452354+0000","last_clean":"2024-04-25T13:45:42.452354+0000","last_became_active":"2024-04-25T13:41:03.408414+0000","last_became_peered":"2024-04-25T13:41:03.408414+0000","last_unstale":"2024-04-25T13:45:42.452354+0000","last_undegraded":"2024-04-25T13:45:42.452354+0000","last_fullsized":"2024-04-25T13:45:42.452354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:11.311497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'94","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707955+0000","last_change":"2024-04-25T13:41:04.426477+0000","last_active":"2024-04-25T13:47:01.707955+0000","last_peered":"2024-04-25T13:47:01.707955+0000","last_clean":"2024-04-25T13:47:01.707955+0000","last_became_active":"2024-04-25T13:41:04.425891+0000","last_became_peered":"2024-04-25T13:41:04.425891+0000","last_unstale":"2024-04-25T13:47:01.707955+0000","last_undegraded":"2024-04-25T13:47:01.707955+0000","last_fullsized":"2024-04-25T13:47:01.707955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'118","reported_seq":138,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.571270+0000","last_change":"2024-04-25T13:41:03.421716+0000","last_active":"2024-04-25T13:46:38.571270+0000","last_peered":"2024-04-25T13:46:38.571270+0000","last_clean":"2024-04-25T13:46:38.571270+0000","last_became_active":"2024-04-25T13:41:03.420848+0000","last_became_peered":"2024-04-25T13:41:03.420848+0000","last_unstale":"2024-04-25T13:46:38.571270+0000","last_undegraded":"2024-04-25T13:46:38.571270+0000","last_fullsized":"2024-04-25T13:46:38.571270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.389116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'87","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.706476+0000","last_change":"2024-04-25T13:41:04.429840+0000","last_active":"2024-04-25T13:47:01.706476+0000","last_peered":"2024-04-25T13:47:01.706476+0000","last_clean":"2024-04-25T13:47:01.706476+0000","last_became_active":"2024-04-25T13:41:04.429404+0000","last_became_peered":"2024-04-25T13:41:04.429404+0000","last_unstale":"2024-04-25T13:47:01.706476+0000","last_undegraded":"2024-04-25T13:47:01.706476+0000","last_fullsized":"2024-04-25T13:47:01.706476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:10.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'106","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:32.450719+0000","last_change":"2024-04-25T13:41:03.415723+0000","last_active":"2024-04-25T13:45:32.450719+0000","last_peered":"2024-04-25T13:45:32.450719+0000","last_clean":"2024-04-25T13:45:32.450719+0000","last_became_active":"2024-04-25T13:41:03.414957+0000","last_became_peered":"2024-04-25T13:41:03.414957+0000","last_unstale":"2024-04-25T13:45:32.450719+0000","last_undegraded":"2024-04-25T13:45:32.450719+0000","last_fullsized":"2024-04-25T13:45:32.450719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.708064+0000","last_change":"2024-04-25T13:41:04.434675+0000","last_active":"2024-04-25T13:47:01.708064+0000","last_peered":"2024-04-25T13:47:01.708064+0000","last_clean":"2024-04-25T13:47:01.708064+0000","last_became_active":"2024-04-25T13:41:04.434194+0000","last_became_peered":"2024-04-25T13:41:04.434194+0000","last_unstale":"2024-04-25T13:47:01.708064+0000","last_undegraded":"2024-04-25T13:47:01.708064+0000","last_fullsized":"2024-04-25T13:47:01.708064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:41.509589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'576","reported_seq":597,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.569119+0000","last_change":"2024-04-25T13:41:03.402131+0000","last_active":"2024-04-25T13:46:38.569119+0000","last_peered":"2024-04-25T13:46:38.569119+0000","last_clean":"2024-04-25T13:46:38.569119+0000","last_became_active":"2024-04-25T13:41:03.401398+0000","last_became_peered":"2024-04-25T13:41:03.401398+0000","last_unstale":"2024-04-25T13:46:38.569119+0000","last_undegraded":"2024-04-25T13:46:38.569119+0000","last_fullsized":"2024-04-25T13:46:38.569119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":4320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'92","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.704161+0000","last_change":"2024-04-25T13:41:04.418743+0000","last_active":"2024-04-25T13:47:01.704161+0000","last_peered":"2024-04-25T13:47:01.704161+0000","last_clean":"2024-04-25T13:47:01.704161+0000","last_became_active":"2024-04-25T13:41:04.417963+0000","last_became_peered":"2024-04-25T13:41:04.417963+0000","last_unstale":"2024-04-25T13:47:01.704161+0000","last_undegraded":"2024-04-25T13:47:01.704161+0000","last_fullsized":"2024-04-25T13:47:01.704161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:34.221653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'134","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:32.450666+0000","last_change":"2024-04-25T13:41:03.445729+0000","last_active":"2024-04-25T13:45:32.450666+0000","last_peered":"2024-04-25T13:45:32.450666+0000","last_clean":"2024-04-25T13:45:32.450666+0000","last_became_active":"2024-04-25T13:41:03.445293+0000","last_became_peered":"2024-04-25T13:41:03.445293+0000","last_unstale":"2024-04-25T13:45:32.450666+0000","last_undegraded":"2024-04-25T13:45:32.450666+0000","last_fullsized":"2024-04-25T13:45:32.450666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'92","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.707261+0000","last_change":"2024-04-25T13:41:51.966509+0000","last_active":"2024-04-25T13:47:01.707261+0000","last_peered":"2024-04-25T13:47:01.707261+0000","last_clean":"2024-04-25T13:47:01.707261+0000","last_became_active":"2024-04-25T13:41:51.965867+0000","last_became_peered":"2024-04-25T13:41:51.965867+0000","last_unstale":"2024-04-25T13:47:01.707261+0000","last_undegraded":"2024-04-25T13:47:01.707261+0000","last_fullsized":"2024-04-25T13:47:01.707261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:14.462796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:02.451274+0000","last_change":"2024-04-25T13:41:00.175142+0000","last_active":"2024-04-25T13:45:02.451274+0000","last_peered":"2024-04-25T13:45:02.451274+0000","last_clean":"2024-04-25T13:45:02.451274+0000","last_became_active":"2024-04-25T13:41:00.172906+0000","last_became_peered":"2024-04-25T13:41:00.172906+0000","last_unstale":"2024-04-25T13:45:02.451274+0000","last_undegraded":"2024-04-25T13:45:02.451274+0000","last_fullsized":"2024-04-25T13:45:02.451274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:40:59.093070+0000","last_clean_scrub_stamp":"2024-04-25T13:40:59.093070+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:38.020124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'122","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.560972+0000","last_change":"2024-04-25T13:41:03.438420+0000","last_active":"2024-04-25T13:46:39.560972+0000","last_peered":"2024-04-25T13:46:39.560972+0000","last_clean":"2024-04-25T13:46:39.560972+0000","last_became_active":"2024-04-25T13:41:03.437569+0000","last_became_peered":"2024-04-25T13:41:03.437569+0000","last_unstale":"2024-04-25T13:46:39.560972+0000","last_undegraded":"2024-04-25T13:46:39.560972+0000","last_fullsized":"2024-04-25T13:46:39.560972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'75","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.703768+0000","last_change":"2024-04-25T13:41:04.417328+0000","last_active":"2024-04-25T13:47:01.703768+0000","last_peered":"2024-04-25T13:47:01.703768+0000","last_clean":"2024-04-25T13:47:01.703768+0000","last_became_active":"2024-04-25T13:41:04.416666+0000","last_became_peered":"2024-04-25T13:41:04.416666+0000","last_unstale":"2024-04-25T13:47:01.703768+0000","last_undegraded":"2024-04-25T13:47:01.703768+0000","last_fullsized":"2024-04-25T13:47:01.703768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:44.895532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'1393","reported_seq":1414,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.567347+0000","last_change":"2024-04-25T13:41:03.431855+0000","last_active":"2024-04-25T13:46:38.567347+0000","last_peered":"2024-04-25T13:46:38.567347+0000","last_clean":"2024-04-25T13:46:38.567347+0000","last_became_active":"2024-04-25T13:41:03.429200+0000","last_became_peered":"2024-04-25T13:41:03.429200+0000","last_unstale":"2024-04-25T13:46:38.567347+0000","last_undegraded":"2024-04-25T13:46:38.567347+0000","last_fullsized":"2024-04-25T13:46:38.567347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1393,"log_dups_size":0,"ondisk_log_size":1393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:17.453861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1260,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'77","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.684329+0000","last_change":"2024-04-25T13:41:04.411548+0000","last_active":"2024-04-25T13:47:01.684329+0000","last_peered":"2024-04-25T13:47:01.684329+0000","last_clean":"2024-04-25T13:47:01.684329+0000","last_became_active":"2024-04-25T13:41:04.400093+0000","last_became_peered":"2024-04-25T13:41:04.400093+0000","last_unstale":"2024-04-25T13:47:01.684329+0000","last_undegraded":"2024-04-25T13:47:01.684329+0000","last_fullsized":"2024-04-25T13:47:01.684329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'425","reported_seq":750,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.545454+0000","last_change":"2024-04-25T13:41:03.415949+0000","last_active":"2024-04-25T13:46:39.545454+0000","last_peered":"2024-04-25T13:46:39.545454+0000","last_clean":"2024-04-25T13:46:39.545454+0000","last_became_active":"2024-04-25T13:41:03.414899+0000","last_became_peered":"2024-04-25T13:41:03.414899+0000","last_unstale":"2024-04-25T13:46:39.545454+0000","last_undegraded":"2024-04-25T13:46:39.545454+0000","last_fullsized":"2024-04-25T13:46:39.545454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:52.799398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":769923,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":305,"num_write_kb":953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'94","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:07.463131+0000","last_change":"2024-04-25T13:41:04.403032+0000","last_active":"2024-04-25T13:47:07.463131+0000","last_peered":"2024-04-25T13:47:07.463131+0000","last_clean":"2024-04-25T13:47:07.463131+0000","last_became_active":"2024-04-25T13:41:04.402055+0000","last_became_peered":"2024-04-25T13:41:04.402055+0000","last_unstale":"2024-04-25T13:47:07.463131+0000","last_undegraded":"2024-04-25T13:47:07.463131+0000","last_fullsized":"2024-04-25T13:47:07.463131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1421","reported_seq":1441,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.572981+0000","last_change":"2024-04-25T13:41:03.447547+0000","last_active":"2024-04-25T13:46:38.572981+0000","last_peered":"2024-04-25T13:46:38.572981+0000","last_clean":"2024-04-25T13:46:38.572981+0000","last_became_active":"2024-04-25T13:41:03.444429+0000","last_became_peered":"2024-04-25T13:41:03.444429+0000","last_unstale":"2024-04-25T13:46:38.572981+0000","last_undegraded":"2024-04-25T13:46:38.572981+0000","last_fullsized":"2024-04-25T13:46:38.572981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":1421,"log_dups_size":0,"ondisk_log_size":1421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.667955+0000","last_change":"2024-04-25T13:41:04.398647+0000","last_active":"2024-04-25T13:47:01.667955+0000","last_peered":"2024-04-25T13:47:01.667955+0000","last_clean":"2024-04-25T13:47:01.667955+0000","last_became_active":"2024-04-25T13:41:04.398287+0000","last_became_peered":"2024-04-25T13:41:04.398287+0000","last_unstale":"2024-04-25T13:47:01.667955+0000","last_undegraded":"2024-04-25T13:47:01.667955+0000","last_fullsized":"2024-04-25T13:47:01.667955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:06.264127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'115","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.108231+0000","last_change":"2024-04-25T13:41:03.414535+0000","last_active":"2024-04-25T13:45:30.108231+0000","last_peered":"2024-04-25T13:45:30.108231+0000","last_clean":"2024-04-25T13:45:30.108231+0000","last_became_active":"2024-04-25T13:41:03.414145+0000","last_became_peered":"2024-04-25T13:41:03.414145+0000","last_unstale":"2024-04-25T13:45:30.108231+0000","last_undegraded":"2024-04-25T13:45:30.108231+0000","last_fullsized":"2024-04-25T13:45:30.108231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'92","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.703641+0000","last_change":"2024-04-25T13:41:04.419186+0000","last_active":"2024-04-25T13:47:01.703641+0000","last_peered":"2024-04-25T13:47:01.703641+0000","last_clean":"2024-04-25T13:47:01.703641+0000","last_became_active":"2024-04-25T13:41:04.417831+0000","last_became_peered":"2024-04-25T13:41:04.417831+0000","last_unstale":"2024-04-25T13:47:01.703641+0000","last_undegraded":"2024-04-25T13:47:01.703641+0000","last_fullsized":"2024-04-25T13:47:01.703641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:23.217905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'105","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.560065+0000","last_change":"2024-04-25T13:41:03.424206+0000","last_active":"2024-04-25T13:46:38.560065+0000","last_peered":"2024-04-25T13:46:38.560065+0000","last_clean":"2024-04-25T13:46:38.560065+0000","last_became_active":"2024-04-25T13:41:03.423176+0000","last_became_peered":"2024-04-25T13:41:03.423176+0000","last_unstale":"2024-04-25T13:46:38.560065+0000","last_undegraded":"2024-04-25T13:46:38.560065+0000","last_fullsized":"2024-04-25T13:46:38.560065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:23.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'78","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.697895+0000","last_change":"2024-04-25T13:41:04.402353+0000","last_active":"2024-04-25T13:47:01.697895+0000","last_peered":"2024-04-25T13:47:01.697895+0000","last_clean":"2024-04-25T13:47:01.697895+0000","last_became_active":"2024-04-25T13:41:04.402014+0000","last_became_peered":"2024-04-25T13:41:04.402014+0000","last_unstale":"2024-04-25T13:47:01.697895+0000","last_undegraded":"2024-04-25T13:47:01.697895+0000","last_fullsized":"2024-04-25T13:47:01.697895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'358","reported_seq":379,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:44.616232+0000","last_change":"2024-04-25T13:41:03.439449+0000","last_active":"2024-04-25T13:46:44.616232+0000","last_peered":"2024-04-25T13:46:44.616232+0000","last_clean":"2024-04-25T13:46:44.616232+0000","last_became_active":"2024-04-25T13:41:03.439074+0000","last_became_peered":"2024-04-25T13:41:03.439074+0000","last_unstale":"2024-04-25T13:46:44.616232+0000","last_undegraded":"2024-04-25T13:46:44.616232+0000","last_fullsized":"2024-04-25T13:46:44.616232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'79","reported_seq":97,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.699026+0000","last_change":"2024-04-25T13:41:04.418630+0000","last_active":"2024-04-25T13:47:01.699026+0000","last_peered":"2024-04-25T13:47:01.699026+0000","last_clean":"2024-04-25T13:47:01.699026+0000","last_became_active":"2024-04-25T13:41:04.418330+0000","last_became_peered":"2024-04-25T13:41:04.418330+0000","last_unstale":"2024-04-25T13:47:01.699026+0000","last_undegraded":"2024-04-25T13:47:01.699026+0000","last_fullsized":"2024-04-25T13:47:01.699026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:26.695530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'120","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.106212+0000","last_change":"2024-04-25T13:41:03.435851+0000","last_active":"2024-04-25T13:45:30.106212+0000","last_peered":"2024-04-25T13:45:30.106212+0000","last_clean":"2024-04-25T13:45:30.106212+0000","last_became_active":"2024-04-25T13:41:03.434870+0000","last_became_peered":"2024-04-25T13:41:03.434870+0000","last_unstale":"2024-04-25T13:45:30.106212+0000","last_undegraded":"2024-04-25T13:45:30.106212+0000","last_fullsized":"2024-04-25T13:45:30.106212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:11.490828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'88","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.705814+0000","last_change":"2024-04-25T13:41:04.426962+0000","last_active":"2024-04-25T13:47:01.705814+0000","last_peered":"2024-04-25T13:47:01.705814+0000","last_clean":"2024-04-25T13:47:01.705814+0000","last_became_active":"2024-04-25T13:41:04.426424+0000","last_became_peered":"2024-04-25T13:41:04.426424+0000","last_unstale":"2024-04-25T13:47:01.705814+0000","last_undegraded":"2024-04-25T13:47:01.705814+0000","last_fullsized":"2024-04-25T13:47:01.705814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'654","reported_seq":674,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.565821+0000","last_change":"2024-04-25T13:41:03.430095+0000","last_active":"2024-04-25T13:46:38.565821+0000","last_peered":"2024-04-25T13:46:38.565821+0000","last_clean":"2024-04-25T13:46:38.565821+0000","last_became_active":"2024-04-25T13:41:03.429094+0000","last_became_peered":"2024-04-25T13:41:03.429094+0000","last_unstale":"2024-04-25T13:46:38.565821+0000","last_undegraded":"2024-04-25T13:46:38.565821+0000","last_fullsized":"2024-04-25T13:46:38.565821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:49.736496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'81","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.679923+0000","last_change":"2024-04-25T13:41:04.413097+0000","last_active":"2024-04-25T13:47:01.679923+0000","last_peered":"2024-04-25T13:47:01.679923+0000","last_clean":"2024-04-25T13:47:01.679923+0000","last_became_active":"2024-04-25T13:41:04.412572+0000","last_became_peered":"2024-04-25T13:41:04.412572+0000","last_unstale":"2024-04-25T13:47:01.679923+0000","last_undegraded":"2024-04-25T13:47:01.679923+0000","last_fullsized":"2024-04-25T13:47:01.679923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:50.740570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'126","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.564687+0000","last_change":"2024-04-25T13:41:03.411890+0000","last_active":"2024-04-25T13:46:38.564687+0000","last_peered":"2024-04-25T13:46:38.564687+0000","last_clean":"2024-04-25T13:46:38.564687+0000","last_became_active":"2024-04-25T13:41:03.411481+0000","last_became_peered":"2024-04-25T13:41:03.411481+0000","last_unstale":"2024-04-25T13:46:38.564687+0000","last_undegraded":"2024-04-25T13:46:38.564687+0000","last_fullsized":"2024-04-25T13:46:38.564687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'90","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702621+0000","last_change":"2024-04-25T13:41:04.408896+0000","last_active":"2024-04-25T13:47:01.702621+0000","last_peered":"2024-04-25T13:47:01.702621+0000","last_clean":"2024-04-25T13:47:01.702621+0000","last_became_active":"2024-04-25T13:41:04.408517+0000","last_became_peered":"2024-04-25T13:41:04.408517+0000","last_unstale":"2024-04-25T13:47:01.702621+0000","last_undegraded":"2024-04-25T13:47:01.702621+0000","last_fullsized":"2024-04-25T13:47:01.702621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:12.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'128","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:31.781903+0000","last_change":"2024-04-25T13:41:03.408129+0000","last_active":"2024-04-25T13:46:31.781903+0000","last_peered":"2024-04-25T13:46:31.781903+0000","last_clean":"2024-04-25T13:46:31.781903+0000","last_became_active":"2024-04-25T13:41:03.407713+0000","last_became_peered":"2024-04-25T13:41:03.407713+0000","last_unstale":"2024-04-25T13:46:31.781903+0000","last_undegraded":"2024-04-25T13:46:31.781903+0000","last_fullsized":"2024-04-25T13:46:31.781903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'94","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702570+0000","last_change":"2024-04-25T13:41:04.424601+0000","last_active":"2024-04-25T13:47:01.702570+0000","last_peered":"2024-04-25T13:47:01.702570+0000","last_clean":"2024-04-25T13:47:01.702570+0000","last_became_active":"2024-04-25T13:41:04.424153+0000","last_became_peered":"2024-04-25T13:41:04.424153+0000","last_unstale":"2024-04-25T13:47:01.702570+0000","last_undegraded":"2024-04-25T13:47:01.702570+0000","last_fullsized":"2024-04-25T13:47:01.702570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:03.389951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'576","reported_seq":596,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.562196+0000","last_change":"2024-04-25T13:41:03.431525+0000","last_active":"2024-04-25T13:46:39.562196+0000","last_peered":"2024-04-25T13:46:39.562196+0000","last_clean":"2024-04-25T13:46:39.562196+0000","last_became_active":"2024-04-25T13:41:03.430716+0000","last_became_peered":"2024-04-25T13:41:03.430716+0000","last_unstale":"2024-04-25T13:46:39.562196+0000","last_undegraded":"2024-04-25T13:46:39.562196+0000","last_fullsized":"2024-04-25T13:46:39.562196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:46.480379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'75","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.675680+0000","last_change":"2024-04-25T13:41:04.424614+0000","last_active":"2024-04-25T13:47:01.675680+0000","last_peered":"2024-04-25T13:47:01.675680+0000","last_clean":"2024-04-25T13:47:01.675680+0000","last_became_active":"2024-04-25T13:41:04.424248+0000","last_became_peered":"2024-04-25T13:41:04.424248+0000","last_unstale":"2024-04-25T13:47:01.675680+0000","last_undegraded":"2024-04-25T13:47:01.675680+0000","last_fullsized":"2024-04-25T13:47:01.675680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.271242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'77","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.682341+0000","last_change":"2024-04-25T13:41:04.425893+0000","last_active":"2024-04-25T13:47:01.682341+0000","last_peered":"2024-04-25T13:47:01.682341+0000","last_clean":"2024-04-25T13:47:01.682341+0000","last_became_active":"2024-04-25T13:41:04.424475+0000","last_became_peered":"2024-04-25T13:41:04.424475+0000","last_unstale":"2024-04-25T13:47:01.682341+0000","last_undegraded":"2024-04-25T13:47:01.682341+0000","last_fullsized":"2024-04-25T13:47:01.682341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:11.721677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'113","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.560700+0000","last_change":"2024-04-25T13:41:03.447296+0000","last_active":"2024-04-25T13:46:39.560700+0000","last_peered":"2024-04-25T13:46:39.560700+0000","last_clean":"2024-04-25T13:46:39.560700+0000","last_became_active":"2024-04-25T13:41:03.446522+0000","last_became_peered":"2024-04-25T13:41:03.446522+0000","last_unstale":"2024-04-25T13:46:39.560700+0000","last_undegraded":"2024-04-25T13:46:39.560700+0000","last_fullsized":"2024-04-25T13:46:39.560700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:05.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'74","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.692806+0000","last_change":"2024-04-25T13:41:04.424211+0000","last_active":"2024-04-25T13:47:01.692806+0000","last_peered":"2024-04-25T13:47:01.692806+0000","last_clean":"2024-04-25T13:47:01.692806+0000","last_became_active":"2024-04-25T13:41:04.423899+0000","last_became_peered":"2024-04-25T13:41:04.423899+0000","last_unstale":"2024-04-25T13:47:01.692806+0000","last_undegraded":"2024-04-25T13:47:01.692806+0000","last_fullsized":"2024-04-25T13:47:01.692806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.871935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'992","reported_seq":1012,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:38.571565+0000","last_change":"2024-04-25T13:41:03.441717+0000","last_active":"2024-04-25T13:46:38.571565+0000","last_peered":"2024-04-25T13:46:38.571565+0000","last_clean":"2024-04-25T13:46:38.571565+0000","last_became_active":"2024-04-25T13:41:03.440886+0000","last_became_peered":"2024-04-25T13:41:03.440886+0000","last_unstale":"2024-04-25T13:46:38.571565+0000","last_undegraded":"2024-04-25T13:46:38.571565+0000","last_fullsized":"2024-04-25T13:46:38.571565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.702887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":8413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'76","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.702145+0000","last_change":"2024-04-25T13:41:04.423577+0000","last_active":"2024-04-25T13:47:01.702145+0000","last_peered":"2024-04-25T13:47:01.702145+0000","last_clean":"2024-04-25T13:47:01.702145+0000","last_became_active":"2024-04-25T13:41:04.422496+0000","last_became_peered":"2024-04-25T13:41:04.422496+0000","last_unstale":"2024-04-25T13:47:01.702145+0000","last_undegraded":"2024-04-25T13:47:01.702145+0000","last_fullsized":"2024-04-25T13:47:01.702145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'430","reported_seq":451,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:46:39.550665+0000","last_change":"2024-04-25T13:41:03.418067+0000","last_active":"2024-04-25T13:46:39.550665+0000","last_peered":"2024-04-25T13:46:39.550665+0000","last_clean":"2024-04-25T13:46:39.550665+0000","last_became_active":"2024-04-25T13:41:03.417592+0000","last_became_peered":"2024-04-25T13:41:03.417592+0000","last_unstale":"2024-04-25T13:46:39.550665+0000","last_undegraded":"2024-04-25T13:46:39.550665+0000","last_fullsized":"2024-04-25T13:46:39.550665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:32.150861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'82","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:01.693266+0000","last_change":"2024-04-25T13:41:04.410387+0000","last_active":"2024-04-25T13:47:01.693266+0000","last_peered":"2024-04-25T13:47:01.693266+0000","last_clean":"2024-04-25T13:47:01.693266+0000","last_became_active":"2024-04-25T13:41:04.410065+0000","last_became_peered":"2024-04-25T13:41:04.410065+0000","last_unstale":"2024-04-25T13:47:01.693266+0000","last_undegraded":"2024-04-25T13:47:01.693266+0000","last_fullsized":"2024-04-25T13:47:01.693266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:03.367022+0000","last_clean_scrub_stamp":"2024-04-25T13:41:03.367022+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:04.476475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'435","reported_seq":456,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:45:30.108334+0000","last_change":"2024-04-25T13:41:03.425103+0000","last_active":"2024-04-25T13:45:30.108334+0000","last_peered":"2024-04-25T13:45:30.108334+0000","last_clean":"2024-04-25T13:45:30.108334+0000","last_became_active":"2024-04-25T13:41:03.424688+0000","last_became_peered":"2024-04-25T13:41:03.424688+0000","last_unstale":"2024-04-25T13:45:30.108334+0000","last_undegraded":"2024-04-25T13:45:30.108334+0000","last_fullsized":"2024-04-25T13:45:30.108334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:02.362949+0000","last_clean_scrub_stamp":"2024-04-25T13:41:02.362949+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75674842,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":10892,"num_write_kb":79992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113328128,"data_stored":151349684,"data_compressed":10339548,"data_compressed_allocated":20144128,"data_compressed_original":58220544,"omap_allocated":0,"internal_metadata":0},"log_size":14453,"ondisk_log_size":14453,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95428,"kb_used_data":23996,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276412,"statfs":{"total":96636764160,"available":96539045888,"internally_reserved":0,"allocated":24571904,"data_stored":34233256,"data_compressed":2467561,"data_compressed_allocated":4726784,"data_compressed_original":14548992,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50572,"kb_used_data":11076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321268,"statfs":{"total":96636764160,"available":96584978432,"internally_reserved":0,"allocated":11341824,"data_stored":16865762,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58792,"kb_used_data":13728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94313048,"statfs":{"total":96636764160,"available":96576561152,"internally_reserved":0,"allocated":14057472,"data_stored":16271157,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89060,"kb_used_data":21788,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94282780,"statfs":{"total":96636764160,"available":96545566720,"internally_reserved":0,"allocated":22310912,"data_stored":28854105,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":10256384,"data_stored":13441381,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":857797,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65576,"kb_used_data":16352,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94306264,"statfs":{"total":96636764160,"available":96569614336,"internally_reserved":0,"allocated":16744448,"data_stored":21059554,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":14784,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":15138816,"data_stored":21650400,"data_compressed":1741521,"data_compressed_allocated":3354624,"data_compressed_original":10035200,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":20972158,"data_compressed":1708275,"data_compressed_allocated":3309568,"data_compressed_original":9461760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16502784,"data_stored":20971680,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":769923,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":13353507,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":28766231,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13815808,"data_stored":16183283,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11100160,"data_stored":16777888,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24264704,"data_stored":33555014,"data_compressed":2434315,"data_compressed_allocated":4681728,"data_compressed_original":13975552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:47:15.572 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.573 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.573 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.573 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.573 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.573 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.573 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.573 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.573 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.573 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.574 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.575 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.576 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.576 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.576 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.576 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.576 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.576 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.576 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.576 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.576 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.577 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.578 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.578 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.578 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.578 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.578 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.578 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.578 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.578 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.578 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.579 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.579 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.579 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.579 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.579 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.579 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.579 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T13:40:59.093070+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=40, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.580 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.580 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.580 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.580 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.580 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.580 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.580 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.580 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.580 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.581 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.582 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.582 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.582 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.582 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.582 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.582 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.582 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.582 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.582 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.583 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.583 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.583 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T13:41:03.367022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.583 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T13:41:02.362949+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=47, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:47:15.583 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T13:47:35.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:47:35.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd316ee5640 1 Processor -- start 2024-04-25T13:47:35.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd316ee5640 1 -- start start 2024-04-25T13:47:35.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd316ee5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd3100b85f0 0x7fd310146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:35.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd316ee5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:35.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd316ee5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd310074510 con 0x7fd310071900 2024-04-25T13:47:35.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd316ee5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd310071d10 con 0x7fd3100b85f0 2024-04-25T13:47:35.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd316ee5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd310150ff0 con 0x7fd310073bc0 2024-04-25T13:47:35.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd314c81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd3100b85f0 0x7fd310146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:35.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd315482640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:35.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd315482640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310073fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:50742/0 (socket says 172.21.15.77:50742) 2024-04-25T13:47:35.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd315482640 1 -- 172.21.15.77:0/2829683365 learned_addr learned my addr 172.21.15.77:0/2829683365 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:35.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd314c81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd3100b85f0 0x7fd310146cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.77:34262/0 (socket says 172.21.15.77:34262) 2024-04-25T13:47:35.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd315482640 1 -- 172.21.15.77:0/2829683365 >> v2:172.21.15.96:3300/0 conn(0x7fd3100b85f0 msgr2=0x7fd310146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:35.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd315482640 1 --2- 172.21.15.77:0/2829683365 >> v2:172.21.15.96:3300/0 conn(0x7fd3100b85f0 0x7fd310146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:35.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd315482640 1 -- 172.21.15.77:0/2829683365 >> v1:172.21.15.96:6789/0 conn(0x7fd310071900 legacy=0x7fd31006f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:35.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.745+0000 7fd315482640 1 -- 172.21.15.77:0/2829683365 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3100733c0 con 0x7fd310073bc0 2024-04-25T13:47:35.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd315482640 1 --2- 172.21.15.77:0/2829683365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310073fd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd308009e50 tx=0x7fd30801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84166a06a6be4c69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:35.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd30f7fe640 1 -- 172.21.15.77:0/2829683365 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3080a57f0 con 0x7fd310073bc0 2024-04-25T13:47:35.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd30f7fe640 1 -- 172.21.15.77:0/2829683365 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3080a5990 con 0x7fd310073bc0 2024-04-25T13:47:35.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd30f7fe640 1 -- 172.21.15.77:0/2829683365 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3080a5d60 con 0x7fd310073bc0 2024-04-25T13:47:35.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd316ee5640 1 -- 172.21.15.77:0/2829683365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 msgr2=0x7fd310073fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:35.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd316ee5640 1 --2- 172.21.15.77:0/2829683365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310073fd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd308009e50 tx=0x7fd30801c970 comp rx=0 tx=0).stop 2024-04-25T13:47:35.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd316ee5640 1 -- 172.21.15.77:0/2829683365 shutdown_connections 2024-04-25T13:47:35.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd316ee5640 1 --2- 172.21.15.77:0/2829683365 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310073fd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:35.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd316ee5640 1 --2- 172.21.15.77:0/2829683365 >> v2:172.21.15.96:3300/0 conn(0x7fd3100b85f0 0x7fd310146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:35.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd316ee5640 1 -- 172.21.15.77:0/2829683365 >> 172.21.15.77:0/2829683365 conn(0x7fd3100c02a0 msgr2=0x7fd3100c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:35.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd316ee5640 1 -- 172.21.15.77:0/2829683365 shutdown_connections 2024-04-25T13:47:35.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.749+0000 7fd316ee5640 1 -- 172.21.15.77:0/2829683365 wait complete. 2024-04-25T13:47:35.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 Processor -- start 2024-04-25T13:47:35.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 -- start start 2024-04-25T13:47:35.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd310071900 0x7fd31013e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:35.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310137730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:35.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3100b85f0 0x7fd310137c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:35.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd31015d540 con 0x7fd3100b85f0 2024-04-25T13:47:35.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd31015d3c0 con 0x7fd310071900 2024-04-25T13:47:35.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd31015d6c0 con 0x7fd310073bc0 2024-04-25T13:47:35.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd315482640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3100b85f0 0x7fd310137c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd315482640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3100b85f0 0x7fd310137c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51310/0 (socket says 172.21.15.77:51310) 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd315482640 1 -- 172.21.15.77:0/2977853251 learned_addr learned my addr 172.21.15.77:0/2977853251 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd314c81640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd310071900 0x7fd31013e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd30ffff640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd315482640 1 -- 172.21.15.77:0/2977853251 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 msgr2=0x7fd310137730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd315482640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310137730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd315482640 1 -- 172.21.15.77:0/2977853251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd310071900 msgr2=0x7fd31013e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd315482640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd310071900 0x7fd31013e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd315482640 1 -- 172.21.15.77:0/2977853251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd310151c80 con 0x7fd3100b85f0 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd315482640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3100b85f0 0x7fd310137c70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd308009e50 tx=0x7fd308019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:35.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd30d7fa640 1 -- 172.21.15.77:0/2977853251 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3080b8670 con 0x7fd3100b85f0 2024-04-25T13:47:35.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3101ed780 con 0x7fd3100b85f0 2024-04-25T13:47:35.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd30d7fa640 1 -- 172.21.15.77:0/2977853251 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3080be070 con 0x7fd3100b85f0 2024-04-25T13:47:35.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd30d7fa640 1 -- 172.21.15.77:0/2977853251 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3080b8a70 con 0x7fd3100b85f0 2024-04-25T13:47:35.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.753+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd310153990 con 0x7fd3100b85f0 2024-04-25T13:47:35.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.757+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31006a280 con 0x7fd3100b85f0 2024-04-25T13:47:35.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.757+0000 7fd30d7fa640 1 -- 172.21.15.77:0/2977853251 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd3080b8c10 con 0x7fd3100b85f0 2024-04-25T13:47:35.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.757+0000 7fd30d7fa640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2fc06f430 0x7fd2fc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:35.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.757+0000 7fd30d7fa640 1 -- 172.21.15.77:0/2977853251 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fd30812a380 con 0x7fd3100b85f0 2024-04-25T13:47:35.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.757+0000 7fd314c81640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2fc06f430 0x7fd2fc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:35.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.757+0000 7fd314c81640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2fc06f430 0x7fd2fc071940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd310070830 tx=0x7fd300006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:35.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.761+0000 7fd30d7fa640 1 -- 172.21.15.77:0/2977853251 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd308016620 con 0x7fd3100b85f0 2024-04-25T13:47:35.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.921+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 --> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd310145f20 con 0x7fd2fc06f430 2024-04-25T13:47:35.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.929+0000 7fd30d7fa640 1 -- 172.21.15.77:0/2977853251 <== mgr.4105 v2:172.21.15.77:6832/4289912412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253566 (secure 0 0 0) 0x7fd310145f20 con 0x7fd2fc06f430 2024-04-25T13:47:35.932 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:35.934 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2fc06f430 msgr2=0x7fd2fc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2fc06f430 0x7fd2fc071940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd310070830 tx=0x7fd300006f90 comp rx=0 tx=0).stop 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3100b85f0 msgr2=0x7fd310137c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3100b85f0 0x7fd310137c70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd308009e50 tx=0x7fd308019710 comp rx=0 tx=0).stop 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 shutdown_connections 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd2fc06f430 0x7fd2fc071940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3100b85f0 0x7fd310137c70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd310073bc0 0x7fd310137730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 --2- 172.21.15.77:0/2977853251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd310071900 0x7fd31013e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 >> 172.21.15.77:0/2977853251 conn(0x7fd3100c02a0 msgr2=0x7fd3100c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 shutdown_connections 2024-04-25T13:47:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:35.933+0000 7fd316ee5640 1 -- 172.21.15.77:0/2977853251 wait complete. 2024-04-25T13:47:35.953 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-04-25T13:47:34.522369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":76265210,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":371,"num_read_kb":1008,"num_write":10993,"num_write_kb":81620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19845,"ondisk_log_size":19845,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":509232,"kb_used_data":112688,"kb_used_omap":12,"kb_used_meta":396467,"kb_avail":754465488,"statfs":{"total":773094113280,"available":772572659712,"internally_reserved":0,"allocated":115392512,"data_stored":153233412,"data_compressed":10406040,"data_compressed_allocated":20234240,"data_compressed_original":59367424,"omap_allocated":12752,"internal_metadata":405982768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004909"},"pg_stats":[{"pgid":"3.3f","version":"23'91","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:28.220066+0000","last_change":"2024-04-25T13:47:28.220137+0000","last_active":"2024-04-25T13:47:28.220066+0000","last_peered":"2024-04-25T13:47:28.220066+0000","last_clean":"2024-04-25T13:47:28.220066+0000","last_became_active":"2024-04-25T13:41:04.434108+0000","last_became_peered":"2024-04-25T13:41:04.434108+0000","last_unstale":"2024-04-25T13:47:28.220066+0000","last_undegraded":"2024-04-25T13:47:28.220066+0000","last_fullsized":"2024-04-25T13:47:28.220066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'91","last_scrub_stamp":"2024-04-25T13:47:28.219839+0000","last_deep_scrub":"23'91","last_deep_scrub_stamp":"2024-04-25T13:47:28.219839+0000","last_clean_scrub_stamp":"2024-04-25T13:47:28.219839+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.491809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'80","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:24.024843+0000","last_change":"2024-04-25T13:47:24.024924+0000","last_active":"2024-04-25T13:47:24.024843+0000","last_peered":"2024-04-25T13:47:24.024843+0000","last_clean":"2024-04-25T13:47:24.024843+0000","last_became_active":"2024-04-25T13:41:04.422546+0000","last_became_peered":"2024-04-25T13:41:04.422546+0000","last_unstale":"2024-04-25T13:47:24.024843+0000","last_undegraded":"2024-04-25T13:47:24.024843+0000","last_fullsized":"2024-04-25T13:47:24.024843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'80","last_scrub_stamp":"2024-04-25T13:47:24.024637+0000","last_deep_scrub":"23'80","last_deep_scrub_stamp":"2024-04-25T13:47:24.024637+0000","last_clean_scrub_stamp":"2024-04-25T13:47:24.024637+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:35.637163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'65","reported_seq":93,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:16.429587+0000","last_change":"2024-04-25T13:47:16.429587+0000","last_active":"2024-04-25T13:47:16.429587+0000","last_peered":"2024-04-25T13:47:16.429587+0000","last_clean":"2024-04-25T13:47:16.429587+0000","last_became_active":"2024-04-25T13:41:04.412382+0000","last_became_peered":"2024-04-25T13:41:04.412382+0000","last_unstale":"2024-04-25T13:47:16.429587+0000","last_undegraded":"2024-04-25T13:47:16.429587+0000","last_fullsized":"2024-04-25T13:47:16.429587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'65","last_scrub_stamp":"2024-04-25T13:47:16.429310+0000","last_deep_scrub":"23'65","last_deep_scrub_stamp":"2024-04-25T13:47:16.429310+0000","last_clean_scrub_stamp":"2024-04-25T13:47:16.429310+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:08.533761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'76","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:23.218808+0000","last_change":"2024-04-25T13:47:23.218881+0000","last_active":"2024-04-25T13:47:23.218808+0000","last_peered":"2024-04-25T13:47:23.218808+0000","last_clean":"2024-04-25T13:47:23.218808+0000","last_became_active":"2024-04-25T13:41:04.418367+0000","last_became_peered":"2024-04-25T13:41:04.418367+0000","last_unstale":"2024-04-25T13:47:23.218808+0000","last_undegraded":"2024-04-25T13:47:23.218808+0000","last_fullsized":"2024-04-25T13:47:23.218808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'76","last_scrub_stamp":"2024-04-25T13:47:23.218603+0000","last_deep_scrub":"23'76","last_deep_scrub_stamp":"2024-04-25T13:47:23.218603+0000","last_clean_scrub_stamp":"2024-04-25T13:47:23.218603+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:33.525398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'85","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:15.297306+0000","last_change":"2024-04-25T13:47:15.297448+0000","last_active":"2024-04-25T13:47:15.297306+0000","last_peered":"2024-04-25T13:47:15.297306+0000","last_clean":"2024-04-25T13:47:15.297306+0000","last_became_active":"2024-04-25T13:41:04.428424+0000","last_became_peered":"2024-04-25T13:41:04.428424+0000","last_unstale":"2024-04-25T13:47:15.297306+0000","last_undegraded":"2024-04-25T13:47:15.297306+0000","last_fullsized":"2024-04-25T13:47:15.297306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'85","last_scrub_stamp":"2024-04-25T13:47:15.297059+0000","last_deep_scrub":"23'85","last_deep_scrub_stamp":"2024-04-25T13:47:15.297059+0000","last_clean_scrub_stamp":"2024-04-25T13:47:15.297059+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:54.909870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'80","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:29.275027+0000","last_change":"2024-04-25T13:47:29.275096+0000","last_active":"2024-04-25T13:47:29.275027+0000","last_peered":"2024-04-25T13:47:29.275027+0000","last_clean":"2024-04-25T13:47:29.275027+0000","last_became_active":"2024-04-25T13:41:04.431971+0000","last_became_peered":"2024-04-25T13:41:04.431971+0000","last_unstale":"2024-04-25T13:47:29.275027+0000","last_undegraded":"2024-04-25T13:47:29.275027+0000","last_fullsized":"2024-04-25T13:47:29.275027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'80","last_scrub_stamp":"2024-04-25T13:47:29.274809+0000","last_deep_scrub":"23'80","last_deep_scrub_stamp":"2024-04-25T13:47:29.274809+0000","last_clean_scrub_stamp":"2024-04-25T13:47:29.274809+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:54.250971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'93","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:30.177902+0000","last_change":"2024-04-25T13:47:30.177978+0000","last_active":"2024-04-25T13:47:30.177902+0000","last_peered":"2024-04-25T13:47:30.177902+0000","last_clean":"2024-04-25T13:47:30.177902+0000","last_became_active":"2024-04-25T13:41:04.471082+0000","last_became_peered":"2024-04-25T13:41:04.471082+0000","last_unstale":"2024-04-25T13:47:30.177902+0000","last_undegraded":"2024-04-25T13:47:30.177902+0000","last_fullsized":"2024-04-25T13:47:30.177902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'93","last_scrub_stamp":"2024-04-25T13:47:30.177644+0000","last_deep_scrub":"23'93","last_deep_scrub_stamp":"2024-04-25T13:47:30.177644+0000","last_clean_scrub_stamp":"2024-04-25T13:47:30.177644+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:26.577687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'77","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:18.779013+0000","last_change":"2024-04-25T13:47:18.779081+0000","last_active":"2024-04-25T13:47:18.779013+0000","last_peered":"2024-04-25T13:47:18.779013+0000","last_clean":"2024-04-25T13:47:18.779013+0000","last_became_active":"2024-04-25T13:41:04.410665+0000","last_became_peered":"2024-04-25T13:41:04.410665+0000","last_unstale":"2024-04-25T13:47:18.779013+0000","last_undegraded":"2024-04-25T13:47:18.779013+0000","last_fullsized":"2024-04-25T13:47:18.779013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'77","last_scrub_stamp":"2024-04-25T13:47:18.778795+0000","last_deep_scrub":"23'77","last_deep_scrub_stamp":"2024-04-25T13:47:18.778795+0000","last_clean_scrub_stamp":"2024-04-25T13:47:18.778795+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:33.598059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'89","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:29.195544+0000","last_change":"2024-04-25T13:47:29.195613+0000","last_active":"2024-04-25T13:47:29.195544+0000","last_peered":"2024-04-25T13:47:29.195544+0000","last_clean":"2024-04-25T13:47:29.195544+0000","last_became_active":"2024-04-25T13:41:04.434676+0000","last_became_peered":"2024-04-25T13:41:04.434676+0000","last_unstale":"2024-04-25T13:47:29.195544+0000","last_undegraded":"2024-04-25T13:47:29.195544+0000","last_fullsized":"2024-04-25T13:47:29.195544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'89","last_scrub_stamp":"2024-04-25T13:47:29.195298+0000","last_deep_scrub":"23'89","last_deep_scrub_stamp":"2024-04-25T13:47:29.195298+0000","last_clean_scrub_stamp":"2024-04-25T13:47:29.195298+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:54.171460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'73","reported_seq":99,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:21.310395+0000","last_change":"2024-04-25T13:47:21.310537+0000","last_active":"2024-04-25T13:47:21.310395+0000","last_peered":"2024-04-25T13:47:21.310395+0000","last_clean":"2024-04-25T13:47:21.310395+0000","last_became_active":"2024-04-25T13:41:04.417145+0000","last_became_peered":"2024-04-25T13:41:04.417145+0000","last_unstale":"2024-04-25T13:47:21.310395+0000","last_undegraded":"2024-04-25T13:47:21.310395+0000","last_fullsized":"2024-04-25T13:47:21.310395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'73","last_scrub_stamp":"2024-04-25T13:47:21.310158+0000","last_deep_scrub":"23'73","last_deep_scrub_stamp":"2024-04-25T13:47:21.310158+0000","last_clean_scrub_stamp":"2024-04-25T13:47:21.310158+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:30.912035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'79","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:20.355670+0000","last_change":"2024-04-25T13:47:20.355818+0000","last_active":"2024-04-25T13:47:20.355670+0000","last_peered":"2024-04-25T13:47:20.355670+0000","last_clean":"2024-04-25T13:47:20.355670+0000","last_became_active":"2024-04-25T13:41:04.416982+0000","last_became_peered":"2024-04-25T13:41:04.416982+0000","last_unstale":"2024-04-25T13:47:20.355670+0000","last_undegraded":"2024-04-25T13:47:20.355670+0000","last_fullsized":"2024-04-25T13:47:20.355670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'79","last_scrub_stamp":"2024-04-25T13:47:20.355408+0000","last_deep_scrub":"23'79","last_deep_scrub_stamp":"2024-04-25T13:47:20.355408+0000","last_clean_scrub_stamp":"2024-04-25T13:47:20.355408+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:52.268610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'79","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:17.101223+0000","last_change":"2024-04-25T13:47:17.101314+0000","last_active":"2024-04-25T13:47:17.101223+0000","last_peered":"2024-04-25T13:47:17.101223+0000","last_clean":"2024-04-25T13:47:17.101223+0000","last_became_active":"2024-04-25T13:41:04.412544+0000","last_became_peered":"2024-04-25T13:41:04.412544+0000","last_unstale":"2024-04-25T13:47:17.101223+0000","last_undegraded":"2024-04-25T13:47:17.101223+0000","last_fullsized":"2024-04-25T13:47:17.101223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'79","last_scrub_stamp":"2024-04-25T13:47:17.101014+0000","last_deep_scrub":"23'79","last_deep_scrub_stamp":"2024-04-25T13:47:17.101014+0000","last_clean_scrub_stamp":"2024-04-25T13:47:17.101014+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:23.570307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'84","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:19.799335+0000","last_change":"2024-04-25T13:47:19.799470+0000","last_active":"2024-04-25T13:47:19.799335+0000","last_peered":"2024-04-25T13:47:19.799335+0000","last_clean":"2024-04-25T13:47:19.799335+0000","last_became_active":"2024-04-25T13:41:04.411840+0000","last_became_peered":"2024-04-25T13:41:04.411840+0000","last_unstale":"2024-04-25T13:47:19.799335+0000","last_undegraded":"2024-04-25T13:47:19.799335+0000","last_fullsized":"2024-04-25T13:47:19.799335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'84","last_scrub_stamp":"2024-04-25T13:47:19.798989+0000","last_deep_scrub":"23'84","last_deep_scrub_stamp":"2024-04-25T13:47:19.798989+0000","last_clean_scrub_stamp":"2024-04-25T13:47:19.798989+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.222890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'74","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:20.428912+0000","last_change":"2024-04-25T13:47:20.428996+0000","last_active":"2024-04-25T13:47:20.428912+0000","last_peered":"2024-04-25T13:47:20.428912+0000","last_clean":"2024-04-25T13:47:20.428912+0000","last_became_active":"2024-04-25T13:41:04.426437+0000","last_became_peered":"2024-04-25T13:41:04.426437+0000","last_unstale":"2024-04-25T13:47:20.428912+0000","last_undegraded":"2024-04-25T13:47:20.428912+0000","last_fullsized":"2024-04-25T13:47:20.428912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-04-25T13:47:20.428659+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-04-25T13:47:20.428659+0000","last_clean_scrub_stamp":"2024-04-25T13:47:20.428659+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.852560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'78","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:21.030183+0000","last_change":"2024-04-25T13:47:21.030253+0000","last_active":"2024-04-25T13:47:21.030183+0000","last_peered":"2024-04-25T13:47:21.030183+0000","last_clean":"2024-04-25T13:47:21.030183+0000","last_became_active":"2024-04-25T13:41:04.410362+0000","last_became_peered":"2024-04-25T13:41:04.410362+0000","last_unstale":"2024-04-25T13:47:21.030183+0000","last_undegraded":"2024-04-25T13:47:21.030183+0000","last_fullsized":"2024-04-25T13:47:21.030183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'78","last_scrub_stamp":"2024-04-25T13:47:21.029980+0000","last_deep_scrub":"23'78","last_deep_scrub_stamp":"2024-04-25T13:47:21.029980+0000","last_clean_scrub_stamp":"2024-04-25T13:47:21.029980+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:13.015823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'88","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:26.301635+0000","last_change":"2024-04-25T13:47:26.301707+0000","last_active":"2024-04-25T13:47:26.301635+0000","last_peered":"2024-04-25T13:47:26.301635+0000","last_clean":"2024-04-25T13:47:26.301635+0000","last_became_active":"2024-04-25T13:41:04.429116+0000","last_became_peered":"2024-04-25T13:41:04.429116+0000","last_unstale":"2024-04-25T13:47:26.301635+0000","last_undegraded":"2024-04-25T13:47:26.301635+0000","last_fullsized":"2024-04-25T13:47:26.301635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'88","last_scrub_stamp":"2024-04-25T13:47:26.301414+0000","last_deep_scrub":"23'88","last_deep_scrub_stamp":"2024-04-25T13:47:26.301414+0000","last_clean_scrub_stamp":"2024-04-25T13:47:26.301414+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:59.507731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'80","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:28.310380+0000","last_change":"2024-04-25T13:47:28.310451+0000","last_active":"2024-04-25T13:47:28.310380+0000","last_peered":"2024-04-25T13:47:28.310380+0000","last_clean":"2024-04-25T13:47:28.310380+0000","last_became_active":"2024-04-25T13:41:04.431231+0000","last_became_peered":"2024-04-25T13:41:04.431231+0000","last_unstale":"2024-04-25T13:47:28.310380+0000","last_undegraded":"2024-04-25T13:47:28.310380+0000","last_fullsized":"2024-04-25T13:47:28.310380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'80","last_scrub_stamp":"2024-04-25T13:47:28.310173+0000","last_deep_scrub":"23'80","last_deep_scrub_stamp":"2024-04-25T13:47:28.310173+0000","last_clean_scrub_stamp":"2024-04-25T13:47:28.310173+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:26.448550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'76","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:17.510441+0000","last_change":"2024-04-25T13:47:17.510512+0000","last_active":"2024-04-25T13:47:17.510441+0000","last_peered":"2024-04-25T13:47:17.510441+0000","last_clean":"2024-04-25T13:47:17.510441+0000","last_became_active":"2024-04-25T13:41:04.407553+0000","last_became_peered":"2024-04-25T13:41:04.407553+0000","last_unstale":"2024-04-25T13:47:17.510441+0000","last_undegraded":"2024-04-25T13:47:17.510441+0000","last_fullsized":"2024-04-25T13:47:17.510441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'76","last_scrub_stamp":"2024-04-25T13:47:17.510238+0000","last_deep_scrub":"23'76","last_deep_scrub_stamp":"2024-04-25T13:47:17.510238+0000","last_clean_scrub_stamp":"2024-04-25T13:47:17.510238+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:58.579641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'75","reported_seq":102,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:25.264865+0000","last_change":"2024-04-25T13:47:25.264963+0000","last_active":"2024-04-25T13:47:25.264865+0000","last_peered":"2024-04-25T13:47:25.264865+0000","last_clean":"2024-04-25T13:47:25.264865+0000","last_became_active":"2024-04-25T13:41:04.428597+0000","last_became_peered":"2024-04-25T13:41:04.428597+0000","last_unstale":"2024-04-25T13:47:25.264865+0000","last_undegraded":"2024-04-25T13:47:25.264865+0000","last_fullsized":"2024-04-25T13:47:25.264865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'75","last_scrub_stamp":"2024-04-25T13:47:25.264652+0000","last_deep_scrub":"23'75","last_deep_scrub_stamp":"2024-04-25T13:47:25.264652+0000","last_clean_scrub_stamp":"2024-04-25T13:47:25.264652+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:49.049481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'82","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:22.349126+0000","last_change":"2024-04-25T13:47:22.349195+0000","last_active":"2024-04-25T13:47:22.349126+0000","last_peered":"2024-04-25T13:47:22.349126+0000","last_clean":"2024-04-25T13:47:22.349126+0000","last_became_active":"2024-04-25T13:41:04.423453+0000","last_became_peered":"2024-04-25T13:41:04.423453+0000","last_unstale":"2024-04-25T13:47:22.349126+0000","last_undegraded":"2024-04-25T13:47:22.349126+0000","last_fullsized":"2024-04-25T13:47:22.349126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'82","last_scrub_stamp":"2024-04-25T13:47:22.348915+0000","last_deep_scrub":"23'82","last_deep_scrub_stamp":"2024-04-25T13:47:22.348915+0000","last_clean_scrub_stamp":"2024-04-25T13:47:22.348915+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:37.168179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'83","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:23.450228+0000","last_change":"2024-04-25T13:47:23.450298+0000","last_active":"2024-04-25T13:47:23.450228+0000","last_peered":"2024-04-25T13:47:23.450228+0000","last_clean":"2024-04-25T13:47:23.450228+0000","last_became_active":"2024-04-25T13:41:04.429917+0000","last_became_peered":"2024-04-25T13:41:04.429917+0000","last_unstale":"2024-04-25T13:47:23.450228+0000","last_undegraded":"2024-04-25T13:47:23.450228+0000","last_fullsized":"2024-04-25T13:47:23.450228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'83","last_scrub_stamp":"2024-04-25T13:47:23.450027+0000","last_deep_scrub":"23'83","last_deep_scrub_stamp":"2024-04-25T13:47:23.450027+0000","last_clean_scrub_stamp":"2024-04-25T13:47:23.450027+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:04.893061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'88","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:27.300341+0000","last_change":"2024-04-25T13:47:27.300467+0000","last_active":"2024-04-25T13:47:27.300341+0000","last_peered":"2024-04-25T13:47:27.300341+0000","last_clean":"2024-04-25T13:47:27.300341+0000","last_became_active":"2024-04-25T13:41:04.431160+0000","last_became_peered":"2024-04-25T13:41:04.431160+0000","last_unstale":"2024-04-25T13:47:27.300341+0000","last_undegraded":"2024-04-25T13:47:27.300341+0000","last_fullsized":"2024-04-25T13:47:27.300341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'88","last_scrub_stamp":"2024-04-25T13:47:27.300027+0000","last_deep_scrub":"23'88","last_deep_scrub_stamp":"2024-04-25T13:47:27.300027+0000","last_clean_scrub_stamp":"2024-04-25T13:47:27.300027+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:44.533595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'69","reported_seq":96,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:23.707623+0000","last_change":"2024-04-25T13:47:23.707697+0000","last_active":"2024-04-25T13:47:23.707623+0000","last_peered":"2024-04-25T13:47:23.707623+0000","last_clean":"2024-04-25T13:47:23.707623+0000","last_became_active":"2024-04-25T13:41:04.422815+0000","last_became_peered":"2024-04-25T13:41:04.422815+0000","last_unstale":"2024-04-25T13:47:23.707623+0000","last_undegraded":"2024-04-25T13:47:23.707623+0000","last_fullsized":"2024-04-25T13:47:23.707623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'69","last_scrub_stamp":"2024-04-25T13:47:23.707385+0000","last_deep_scrub":"23'69","last_deep_scrub_stamp":"2024-04-25T13:47:23.707385+0000","last_clean_scrub_stamp":"2024-04-25T13:47:23.707385+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:35.319911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'87","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:19.226698+0000","last_change":"2024-04-25T13:47:19.226767+0000","last_active":"2024-04-25T13:47:19.226698+0000","last_peered":"2024-04-25T13:47:19.226698+0000","last_clean":"2024-04-25T13:47:19.226698+0000","last_became_active":"2024-04-25T13:41:04.414898+0000","last_became_peered":"2024-04-25T13:41:04.414898+0000","last_unstale":"2024-04-25T13:47:19.226698+0000","last_undegraded":"2024-04-25T13:47:19.226698+0000","last_fullsized":"2024-04-25T13:47:19.226698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'87","last_scrub_stamp":"2024-04-25T13:47:19.226494+0000","last_deep_scrub":"23'87","last_deep_scrub_stamp":"2024-04-25T13:47:19.226494+0000","last_clean_scrub_stamp":"2024-04-25T13:47:19.226494+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:23.171648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'91","reported_seq":118,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:22.733672+0000","last_change":"2024-04-25T13:47:22.733741+0000","last_active":"2024-04-25T13:47:22.733672+0000","last_peered":"2024-04-25T13:47:22.733672+0000","last_clean":"2024-04-25T13:47:22.733672+0000","last_became_active":"2024-04-25T13:41:04.421279+0000","last_became_peered":"2024-04-25T13:41:04.421279+0000","last_unstale":"2024-04-25T13:47:22.733672+0000","last_undegraded":"2024-04-25T13:47:22.733672+0000","last_fullsized":"2024-04-25T13:47:22.733672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'91","last_scrub_stamp":"2024-04-25T13:47:22.733432+0000","last_deep_scrub":"23'91","last_deep_scrub_stamp":"2024-04-25T13:47:22.733432+0000","last_clean_scrub_stamp":"2024-04-25T13:47:22.733432+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:04.176466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'98","reported_seq":124,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:26.312607+0000","last_change":"2024-04-25T13:47:26.312673+0000","last_active":"2024-04-25T13:47:26.312607+0000","last_peered":"2024-04-25T13:47:26.312607+0000","last_clean":"2024-04-25T13:47:26.312607+0000","last_became_active":"2024-04-25T13:41:04.431130+0000","last_became_peered":"2024-04-25T13:41:04.431130+0000","last_unstale":"2024-04-25T13:47:26.312607+0000","last_undegraded":"2024-04-25T13:47:26.312607+0000","last_fullsized":"2024-04-25T13:47:26.312607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'98","last_scrub_stamp":"2024-04-25T13:47:26.312398+0000","last_deep_scrub":"23'98","last_deep_scrub_stamp":"2024-04-25T13:47:26.312398+0000","last_clean_scrub_stamp":"2024-04-25T13:47:26.312398+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:07.755432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'80","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:22.019844+0000","last_change":"2024-04-25T13:47:22.019978+0000","last_active":"2024-04-25T13:47:22.019844+0000","last_peered":"2024-04-25T13:47:22.019844+0000","last_clean":"2024-04-25T13:47:22.019844+0000","last_became_active":"2024-04-25T13:41:04.413001+0000","last_became_peered":"2024-04-25T13:41:04.413001+0000","last_unstale":"2024-04-25T13:47:22.019844+0000","last_undegraded":"2024-04-25T13:47:22.019844+0000","last_fullsized":"2024-04-25T13:47:22.019844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'80","last_scrub_stamp":"2024-04-25T13:47:22.019526+0000","last_deep_scrub":"23'80","last_deep_scrub_stamp":"2024-04-25T13:47:22.019526+0000","last_clean_scrub_stamp":"2024-04-25T13:47:22.019526+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:52.246853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'61","reported_seq":82,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:18.484866+0000","last_change":"2024-04-25T13:47:18.484932+0000","last_active":"2024-04-25T13:47:18.484866+0000","last_peered":"2024-04-25T13:47:18.484866+0000","last_clean":"2024-04-25T13:47:18.484866+0000","last_became_active":"2024-04-25T13:41:51.578959+0000","last_became_peered":"2024-04-25T13:41:51.578959+0000","last_unstale":"2024-04-25T13:47:18.484866+0000","last_undegraded":"2024-04-25T13:47:18.484866+0000","last_fullsized":"2024-04-25T13:47:18.484866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'61","last_scrub_stamp":"2024-04-25T13:47:18.484644+0000","last_deep_scrub":"23'61","last_deep_scrub_stamp":"2024-04-25T13:47:18.484644+0000","last_clean_scrub_stamp":"2024-04-25T13:47:18.484644+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:31.962698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"23'87","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:17.453886+0000","last_change":"2024-04-25T13:47:17.453886+0000","last_active":"2024-04-25T13:47:17.453886+0000","last_peered":"2024-04-25T13:47:17.453886+0000","last_clean":"2024-04-25T13:47:17.453886+0000","last_became_active":"2024-04-25T13:41:04.422855+0000","last_became_peered":"2024-04-25T13:41:04.422855+0000","last_unstale":"2024-04-25T13:47:17.453886+0000","last_undegraded":"2024-04-25T13:47:17.453886+0000","last_fullsized":"2024-04-25T13:47:17.453886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'87","last_scrub_stamp":"2024-04-25T13:47:17.453613+0000","last_deep_scrub":"23'87","last_deep_scrub_stamp":"2024-04-25T13:47:17.453613+0000","last_clean_scrub_stamp":"2024-04-25T13:47:17.453613+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:49.366814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'82","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:20.242598+0000","last_change":"2024-04-25T13:47:20.242598+0000","last_active":"2024-04-25T13:47:20.242598+0000","last_peered":"2024-04-25T13:47:20.242598+0000","last_clean":"2024-04-25T13:47:20.242598+0000","last_became_active":"2024-04-25T13:41:04.416177+0000","last_became_peered":"2024-04-25T13:41:04.416177+0000","last_unstale":"2024-04-25T13:47:20.242598+0000","last_undegraded":"2024-04-25T13:47:20.242598+0000","last_fullsized":"2024-04-25T13:47:20.242598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'82","last_scrub_stamp":"2024-04-25T13:47:20.242197+0000","last_deep_scrub":"23'82","last_deep_scrub_stamp":"2024-04-25T13:47:20.242197+0000","last_clean_scrub_stamp":"2024-04-25T13:47:20.242197+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:28:39.456973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'92","reported_seq":125,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:21.411173+0000","last_change":"2024-04-25T13:47:21.411173+0000","last_active":"2024-04-25T13:47:21.411173+0000","last_peered":"2024-04-25T13:47:21.411173+0000","last_clean":"2024-04-25T13:47:21.411173+0000","last_became_active":"2024-04-25T13:41:51.962421+0000","last_became_peered":"2024-04-25T13:41:51.962421+0000","last_unstale":"2024-04-25T13:47:21.411173+0000","last_undegraded":"2024-04-25T13:47:21.411173+0000","last_fullsized":"2024-04-25T13:47:21.411173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'92","last_scrub_stamp":"2024-04-25T13:47:21.410863+0000","last_deep_scrub":"23'92","last_deep_scrub_stamp":"2024-04-25T13:47:21.410863+0000","last_clean_scrub_stamp":"2024-04-25T13:47:21.410863+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:05.438115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'82","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:25.271838+0000","last_change":"2024-04-25T13:47:25.271908+0000","last_active":"2024-04-25T13:47:25.271838+0000","last_peered":"2024-04-25T13:47:25.271838+0000","last_clean":"2024-04-25T13:47:25.271838+0000","last_became_active":"2024-04-25T13:41:04.429518+0000","last_became_peered":"2024-04-25T13:41:04.429518+0000","last_unstale":"2024-04-25T13:47:25.271838+0000","last_undegraded":"2024-04-25T13:47:25.271838+0000","last_fullsized":"2024-04-25T13:47:25.271838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'82","last_scrub_stamp":"2024-04-25T13:47:25.271624+0000","last_deep_scrub":"23'82","last_deep_scrub_stamp":"2024-04-25T13:47:25.271624+0000","last_clean_scrub_stamp":"2024-04-25T13:47:25.271624+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:29.216777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'99","reported_seq":126,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:16.054871+0000","last_change":"2024-04-25T13:47:16.055015+0000","last_active":"2024-04-25T13:47:16.054871+0000","last_peered":"2024-04-25T13:47:16.054871+0000","last_clean":"2024-04-25T13:47:16.054871+0000","last_became_active":"2024-04-25T13:41:04.401821+0000","last_became_peered":"2024-04-25T13:41:04.401821+0000","last_unstale":"2024-04-25T13:47:16.054871+0000","last_undegraded":"2024-04-25T13:47:16.054871+0000","last_fullsized":"2024-04-25T13:47:16.054871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'99","last_scrub_stamp":"2024-04-25T13:47:16.054629+0000","last_deep_scrub":"23'99","last_deep_scrub_stamp":"2024-04-25T13:47:16.054629+0000","last_clean_scrub_stamp":"2024-04-25T13:47:16.054629+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:31.324271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'882","reported_seq":911,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:14.862326+0000","last_change":"2024-04-25T13:47:14.862381+0000","last_active":"2024-04-25T13:47:14.862326+0000","last_peered":"2024-04-25T13:47:14.862326+0000","last_clean":"2024-04-25T13:47:14.862326+0000","last_became_active":"2024-04-25T13:41:03.425239+0000","last_became_peered":"2024-04-25T13:41:03.425239+0000","last_unstale":"2024-04-25T13:47:14.862326+0000","last_undegraded":"2024-04-25T13:47:14.862326+0000","last_fullsized":"2024-04-25T13:47:14.862326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'882","last_scrub_stamp":"2024-04-25T13:47:14.862196+0000","last_deep_scrub":"23'882","last_deep_scrub_stamp":"2024-04-25T13:47:14.862196+0000","last_clean_scrub_stamp":"2024-04-25T13:47:14.862196+0000","objects_scrubbed":1,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:17.498502+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'78","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:14.436759+0000","last_change":"2024-04-25T13:47:14.436807+0000","last_active":"2024-04-25T13:47:14.436759+0000","last_peered":"2024-04-25T13:47:14.436759+0000","last_clean":"2024-04-25T13:47:14.436759+0000","last_became_active":"2024-04-25T13:41:04.400223+0000","last_became_peered":"2024-04-25T13:41:04.400223+0000","last_unstale":"2024-04-25T13:47:14.436759+0000","last_undegraded":"2024-04-25T13:47:14.436759+0000","last_fullsized":"2024-04-25T13:47:14.436759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'78","last_scrub_stamp":"2024-04-25T13:47:14.436620+0000","last_deep_scrub":"23'78","last_deep_scrub_stamp":"2024-04-25T13:47:14.436620+0000","last_clean_scrub_stamp":"2024-04-25T13:47:14.436620+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:12.777908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'463","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:17.419345+0000","last_change":"2024-04-25T13:47:17.419516+0000","last_active":"2024-04-25T13:47:17.419345+0000","last_peered":"2024-04-25T13:47:17.419345+0000","last_clean":"2024-04-25T13:47:17.419345+0000","last_became_active":"2024-04-25T13:41:03.426677+0000","last_became_peered":"2024-04-25T13:41:03.426677+0000","last_unstale":"2024-04-25T13:47:17.419345+0000","last_undegraded":"2024-04-25T13:47:17.419345+0000","last_fullsized":"2024-04-25T13:47:17.419345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'463","last_scrub_stamp":"2024-04-25T13:47:17.419091+0000","last_deep_scrub":"23'463","last_deep_scrub_stamp":"2024-04-25T13:47:17.419091+0000","last_clean_scrub_stamp":"2024-04-25T13:47:17.419091+0000","objects_scrubbed":1,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:15.760379+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":4234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'118","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:15.784687+0000","last_change":"2024-04-25T13:47:15.784816+0000","last_active":"2024-04-25T13:47:15.784687+0000","last_peered":"2024-04-25T13:47:15.784687+0000","last_clean":"2024-04-25T13:47:15.784687+0000","last_became_active":"2024-04-25T13:41:03.436905+0000","last_became_peered":"2024-04-25T13:41:03.436905+0000","last_unstale":"2024-04-25T13:47:15.784687+0000","last_undegraded":"2024-04-25T13:47:15.784687+0000","last_fullsized":"2024-04-25T13:47:15.784687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'118","last_scrub_stamp":"2024-04-25T13:47:15.784337+0000","last_deep_scrub":"23'118","last_deep_scrub_stamp":"2024-04-25T13:47:15.784337+0000","last_clean_scrub_stamp":"2024-04-25T13:47:15.784337+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:07.888788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'87","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:24.688720+0000","last_change":"2024-04-25T13:47:24.688799+0000","last_active":"2024-04-25T13:47:24.688720+0000","last_peered":"2024-04-25T13:47:24.688720+0000","last_clean":"2024-04-25T13:47:24.688720+0000","last_became_active":"2024-04-25T13:41:04.423470+0000","last_became_peered":"2024-04-25T13:41:04.423470+0000","last_unstale":"2024-04-25T13:47:24.688720+0000","last_undegraded":"2024-04-25T13:47:24.688720+0000","last_fullsized":"2024-04-25T13:47:24.688720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'87","last_scrub_stamp":"2024-04-25T13:47:24.688491+0000","last_deep_scrub":"23'87","last_deep_scrub_stamp":"2024-04-25T13:47:24.688491+0000","last_clean_scrub_stamp":"2024-04-25T13:47:24.688491+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:25.936881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'1581","reported_seq":1610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:15.273309+0000","last_change":"2024-04-25T13:47:15.273383+0000","last_active":"2024-04-25T13:47:15.273309+0000","last_peered":"2024-04-25T13:47:15.273309+0000","last_clean":"2024-04-25T13:47:15.273309+0000","last_became_active":"2024-04-25T13:41:03.444412+0000","last_became_peered":"2024-04-25T13:41:03.444412+0000","last_unstale":"2024-04-25T13:47:15.273309+0000","last_undegraded":"2024-04-25T13:47:15.273309+0000","last_fullsized":"2024-04-25T13:47:15.273309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1581","last_scrub_stamp":"2024-04-25T13:47:15.273113+0000","last_deep_scrub":"23'1581","last_deep_scrub_stamp":"2024-04-25T13:47:15.273113+0000","last_clean_scrub_stamp":"2024-04-25T13:47:15.273113+0000","objects_scrubbed":2,"log_size":1581,"log_dups_size":0,"ondisk_log_size":1581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:01.977305+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7794585,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1453,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'89","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:23.003105+0000","last_change":"2024-04-25T13:47:23.003175+0000","last_active":"2024-04-25T13:47:23.003105+0000","last_peered":"2024-04-25T13:47:23.003105+0000","last_clean":"2024-04-25T13:47:23.003105+0000","last_became_active":"2024-04-25T13:41:04.413496+0000","last_became_peered":"2024-04-25T13:41:04.413496+0000","last_unstale":"2024-04-25T13:47:23.003105+0000","last_undegraded":"2024-04-25T13:47:23.003105+0000","last_fullsized":"2024-04-25T13:47:23.003105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'89","last_scrub_stamp":"2024-04-25T13:47:23.002897+0000","last_deep_scrub":"23'89","last_deep_scrub_stamp":"2024-04-25T13:47:23.002897+0000","last_clean_scrub_stamp":"2024-04-25T13:47:23.002897+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:41.629128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'122","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:19.368616+0000","last_change":"2024-04-25T13:47:19.368689+0000","last_active":"2024-04-25T13:47:19.368616+0000","last_peered":"2024-04-25T13:47:19.368616+0000","last_clean":"2024-04-25T13:47:19.368616+0000","last_became_active":"2024-04-25T13:41:03.449629+0000","last_became_peered":"2024-04-25T13:41:03.449629+0000","last_unstale":"2024-04-25T13:47:19.368616+0000","last_undegraded":"2024-04-25T13:47:19.368616+0000","last_fullsized":"2024-04-25T13:47:19.368616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'122","last_scrub_stamp":"2024-04-25T13:47:19.368401+0000","last_deep_scrub":"23'122","last_deep_scrub_stamp":"2024-04-25T13:47:19.368401+0000","last_clean_scrub_stamp":"2024-04-25T13:47:19.368401+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:11.472853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'92","reported_seq":113,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:20.444087+0000","last_change":"2024-04-25T13:47:20.444167+0000","last_active":"2024-04-25T13:47:20.444087+0000","last_peered":"2024-04-25T13:47:20.444087+0000","last_clean":"2024-04-25T13:47:20.444087+0000","last_became_active":"2024-04-25T13:41:51.584089+0000","last_became_peered":"2024-04-25T13:41:51.584089+0000","last_unstale":"2024-04-25T13:47:20.444087+0000","last_undegraded":"2024-04-25T13:47:20.444087+0000","last_fullsized":"2024-04-25T13:47:20.444087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'92","last_scrub_stamp":"2024-04-25T13:47:20.443879+0000","last_deep_scrub":"23'92","last_deep_scrub_stamp":"2024-04-25T13:47:20.443879+0000","last_clean_scrub_stamp":"2024-04-25T13:47:20.443879+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:36.122946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'135","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:16.208960+0000","last_change":"2024-04-25T13:47:16.209136+0000","last_active":"2024-04-25T13:47:16.208960+0000","last_peered":"2024-04-25T13:47:16.208960+0000","last_clean":"2024-04-25T13:47:16.208960+0000","last_became_active":"2024-04-25T13:41:03.444460+0000","last_became_peered":"2024-04-25T13:41:03.444460+0000","last_unstale":"2024-04-25T13:47:16.208960+0000","last_undegraded":"2024-04-25T13:47:16.208960+0000","last_fullsized":"2024-04-25T13:47:16.208960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-04-25T13:47:16.208709+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-04-25T13:47:16.208709+0000","last_clean_scrub_stamp":"2024-04-25T13:47:16.208709+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:25.628882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'80","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:19.474226+0000","last_change":"2024-04-25T13:47:19.474296+0000","last_active":"2024-04-25T13:47:19.474226+0000","last_peered":"2024-04-25T13:47:19.474226+0000","last_clean":"2024-04-25T13:47:19.474226+0000","last_became_active":"2024-04-25T13:41:04.421991+0000","last_became_peered":"2024-04-25T13:41:04.421991+0000","last_unstale":"2024-04-25T13:47:19.474226+0000","last_undegraded":"2024-04-25T13:47:19.474226+0000","last_fullsized":"2024-04-25T13:47:19.474226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'80","last_scrub_stamp":"2024-04-25T13:47:19.474016+0000","last_deep_scrub":"23'80","last_deep_scrub_stamp":"2024-04-25T13:47:19.474016+0000","last_clean_scrub_stamp":"2024-04-25T13:47:19.474016+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:34.293280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'244","reported_seq":273,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:17.995863+0000","last_change":"2024-04-25T13:47:17.995941+0000","last_active":"2024-04-25T13:47:17.995863+0000","last_peered":"2024-04-25T13:47:17.995863+0000","last_clean":"2024-04-25T13:47:17.995863+0000","last_became_active":"2024-04-25T13:41:03.443721+0000","last_became_peered":"2024-04-25T13:41:03.443721+0000","last_unstale":"2024-04-25T13:47:17.995863+0000","last_undegraded":"2024-04-25T13:47:17.995863+0000","last_fullsized":"2024-04-25T13:47:17.995863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'244","last_scrub_stamp":"2024-04-25T13:47:17.995672+0000","last_deep_scrub":"23'244","last_deep_scrub_stamp":"2024-04-25T13:47:17.995672+0000","last_clean_scrub_stamp":"2024-04-25T13:47:17.995672+0000","objects_scrubbed":2,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:57.608483+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'79","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:19.109739+0000","last_change":"2024-04-25T13:47:19.109886+0000","last_active":"2024-04-25T13:47:19.109739+0000","last_peered":"2024-04-25T13:47:19.109739+0000","last_clean":"2024-04-25T13:47:19.109739+0000","last_became_active":"2024-04-25T13:41:04.423569+0000","last_became_peered":"2024-04-25T13:41:04.423569+0000","last_unstale":"2024-04-25T13:47:19.109739+0000","last_undegraded":"2024-04-25T13:47:19.109739+0000","last_fullsized":"2024-04-25T13:47:19.109739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'79","last_scrub_stamp":"2024-04-25T13:47:19.109411+0000","last_deep_scrub":"23'79","last_deep_scrub_stamp":"2024-04-25T13:47:19.109411+0000","last_clean_scrub_stamp":"2024-04-25T13:47:19.109411+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:27.537271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'561","reported_seq":589,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:16.385801+0000","last_change":"2024-04-25T13:47:16.385898+0000","last_active":"2024-04-25T13:47:16.385801+0000","last_peered":"2024-04-25T13:47:16.385801+0000","last_clean":"2024-04-25T13:47:16.385801+0000","last_became_active":"2024-04-25T13:41:03.424990+0000","last_became_peered":"2024-04-25T13:41:03.424990+0000","last_unstale":"2024-04-25T13:47:16.385801+0000","last_undegraded":"2024-04-25T13:47:16.385801+0000","last_fullsized":"2024-04-25T13:47:16.385801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'561","last_scrub_stamp":"2024-04-25T13:47:16.385564+0000","last_deep_scrub":"23'561","last_deep_scrub_stamp":"2024-04-25T13:47:16.385564+0000","last_clean_scrub_stamp":"2024-04-25T13:47:16.385564+0000","objects_scrubbed":4,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:24.908737+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'65","reported_seq":92,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:26.273417+0000","last_change":"2024-04-25T13:47:26.273485+0000","last_active":"2024-04-25T13:47:26.273417+0000","last_peered":"2024-04-25T13:47:26.273417+0000","last_clean":"2024-04-25T13:47:26.273417+0000","last_became_active":"2024-04-25T13:41:04.427802+0000","last_became_peered":"2024-04-25T13:41:04.427802+0000","last_unstale":"2024-04-25T13:47:26.273417+0000","last_undegraded":"2024-04-25T13:47:26.273417+0000","last_fullsized":"2024-04-25T13:47:26.273417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'65","last_scrub_stamp":"2024-04-25T13:47:26.273209+0000","last_deep_scrub":"23'65","last_deep_scrub_stamp":"2024-04-25T13:47:26.273209+0000","last_clean_scrub_stamp":"2024-04-25T13:47:26.273209+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:52.694324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'1529","reported_seq":1559,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:12.498812+0000","last_change":"2024-04-25T13:47:12.498872+0000","last_active":"2024-04-25T13:47:12.498812+0000","last_peered":"2024-04-25T13:47:12.498812+0000","last_clean":"2024-04-25T13:47:12.498812+0000","last_became_active":"2024-04-25T13:41:03.422529+0000","last_became_peered":"2024-04-25T13:41:03.422529+0000","last_unstale":"2024-04-25T13:47:12.498812+0000","last_undegraded":"2024-04-25T13:47:12.498812+0000","last_fullsized":"2024-04-25T13:47:12.498812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1529","last_scrub_stamp":"2024-04-25T13:47:12.498671+0000","last_deep_scrub":"23'1529","last_deep_scrub_stamp":"2024-04-25T13:47:12.498671+0000","last_clean_scrub_stamp":"2024-04-25T13:47:12.498671+0000","objects_scrubbed":4,"log_size":1529,"log_dups_size":0,"ondisk_log_size":1529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:20.926532+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1414,"num_write_kb":8966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'80","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:22.454049+0000","last_change":"2024-04-25T13:47:22.454180+0000","last_active":"2024-04-25T13:47:22.454049+0000","last_peered":"2024-04-25T13:47:22.454049+0000","last_clean":"2024-04-25T13:47:22.454049+0000","last_became_active":"2024-04-25T13:41:04.428641+0000","last_became_peered":"2024-04-25T13:41:04.428641+0000","last_unstale":"2024-04-25T13:47:22.454049+0000","last_undegraded":"2024-04-25T13:47:22.454049+0000","last_fullsized":"2024-04-25T13:47:22.454049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'80","last_scrub_stamp":"2024-04-25T13:47:22.453725+0000","last_deep_scrub":"23'80","last_deep_scrub_stamp":"2024-04-25T13:47:22.453725+0000","last_clean_scrub_stamp":"2024-04-25T13:47:22.453725+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:26.398879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'125","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:18.229016+0000","last_change":"2024-04-25T13:47:18.229142+0000","last_active":"2024-04-25T13:47:18.229016+0000","last_peered":"2024-04-25T13:47:18.229016+0000","last_clean":"2024-04-25T13:47:18.229016+0000","last_became_active":"2024-04-25T13:41:03.449872+0000","last_became_peered":"2024-04-25T13:41:03.449872+0000","last_unstale":"2024-04-25T13:47:18.229016+0000","last_undegraded":"2024-04-25T13:47:18.229016+0000","last_fullsized":"2024-04-25T13:47:18.229016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'125","last_scrub_stamp":"2024-04-25T13:47:18.228687+0000","last_deep_scrub":"23'125","last_deep_scrub_stamp":"2024-04-25T13:47:18.228687+0000","last_clean_scrub_stamp":"2024-04-25T13:47:18.228687+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:42.381038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'85","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:19.458560+0000","last_change":"2024-04-25T13:47:19.458734+0000","last_active":"2024-04-25T13:47:19.458560+0000","last_peered":"2024-04-25T13:47:19.458560+0000","last_clean":"2024-04-25T13:47:19.458560+0000","last_became_active":"2024-04-25T13:41:51.578950+0000","last_became_peered":"2024-04-25T13:41:51.578950+0000","last_unstale":"2024-04-25T13:47:19.458560+0000","last_undegraded":"2024-04-25T13:47:19.458560+0000","last_fullsized":"2024-04-25T13:47:19.458560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'85","last_scrub_stamp":"2024-04-25T13:47:19.458318+0000","last_deep_scrub":"23'85","last_deep_scrub_stamp":"2024-04-25T13:47:19.458318+0000","last_clean_scrub_stamp":"2024-04-25T13:47:19.458318+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.094625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"23'124","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:15.301226+0000","last_change":"2024-04-25T13:47:15.301292+0000","last_active":"2024-04-25T13:47:15.301226+0000","last_peered":"2024-04-25T13:47:15.301226+0000","last_clean":"2024-04-25T13:47:15.301226+0000","last_became_active":"2024-04-25T13:41:03.423037+0000","last_became_peered":"2024-04-25T13:41:03.423037+0000","last_unstale":"2024-04-25T13:47:15.301226+0000","last_undegraded":"2024-04-25T13:47:15.301226+0000","last_fullsized":"2024-04-25T13:47:15.301226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'124","last_scrub_stamp":"2024-04-25T13:47:15.301024+0000","last_deep_scrub":"23'124","last_deep_scrub_stamp":"2024-04-25T13:47:15.301024+0000","last_clean_scrub_stamp":"2024-04-25T13:47:15.301024+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:23.728885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'91","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:24.281077+0000","last_change":"2024-04-25T13:47:24.281146+0000","last_active":"2024-04-25T13:47:24.281077+0000","last_peered":"2024-04-25T13:47:24.281077+0000","last_clean":"2024-04-25T13:47:24.281077+0000","last_became_active":"2024-04-25T13:41:04.429110+0000","last_became_peered":"2024-04-25T13:41:04.429110+0000","last_unstale":"2024-04-25T13:47:24.281077+0000","last_undegraded":"2024-04-25T13:47:24.281077+0000","last_fullsized":"2024-04-25T13:47:24.281077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'91","last_scrub_stamp":"2024-04-25T13:47:24.280865+0000","last_deep_scrub":"23'91","last_deep_scrub_stamp":"2024-04-25T13:47:24.280865+0000","last_clean_scrub_stamp":"2024-04-25T13:47:24.280865+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:48.433216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'138","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:13.476543+0000","last_change":"2024-04-25T13:47:13.476586+0000","last_active":"2024-04-25T13:47:13.476543+0000","last_peered":"2024-04-25T13:47:13.476543+0000","last_clean":"2024-04-25T13:47:13.476543+0000","last_became_active":"2024-04-25T13:41:03.408414+0000","last_became_peered":"2024-04-25T13:41:03.408414+0000","last_unstale":"2024-04-25T13:47:13.476543+0000","last_undegraded":"2024-04-25T13:47:13.476543+0000","last_fullsized":"2024-04-25T13:47:13.476543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'138","last_scrub_stamp":"2024-04-25T13:47:13.476448+0000","last_deep_scrub":"23'138","last_deep_scrub_stamp":"2024-04-25T13:47:13.476448+0000","last_clean_scrub_stamp":"2024-04-25T13:47:13.476448+0000","objects_scrubbed":4,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:24.692135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'94","reported_seq":121,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:23.276796+0000","last_change":"2024-04-25T13:47:23.276932+0000","last_active":"2024-04-25T13:47:23.276796+0000","last_peered":"2024-04-25T13:47:23.276796+0000","last_clean":"2024-04-25T13:47:23.276796+0000","last_became_active":"2024-04-25T13:41:04.425891+0000","last_became_peered":"2024-04-25T13:41:04.425891+0000","last_unstale":"2024-04-25T13:47:23.276796+0000","last_undegraded":"2024-04-25T13:47:23.276796+0000","last_fullsized":"2024-04-25T13:47:23.276796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'94","last_scrub_stamp":"2024-04-25T13:47:23.276529+0000","last_deep_scrub":"23'94","last_deep_scrub_stamp":"2024-04-25T13:47:23.276529+0000","last_clean_scrub_stamp":"2024-04-25T13:47:23.276529+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:15.298201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'119","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:14.121138+0000","last_change":"2024-04-25T13:47:14.121277+0000","last_active":"2024-04-25T13:47:14.121138+0000","last_peered":"2024-04-25T13:47:14.121138+0000","last_clean":"2024-04-25T13:47:14.121138+0000","last_became_active":"2024-04-25T13:41:03.420848+0000","last_became_peered":"2024-04-25T13:41:03.420848+0000","last_unstale":"2024-04-25T13:47:14.121138+0000","last_undegraded":"2024-04-25T13:47:14.121138+0000","last_fullsized":"2024-04-25T13:47:14.121138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-04-25T13:47:14.120900+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-04-25T13:47:14.120900+0000","last_clean_scrub_stamp":"2024-04-25T13:47:14.120900+0000","objects_scrubbed":1,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:06.849330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'87","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:24.254373+0000","last_change":"2024-04-25T13:47:24.254461+0000","last_active":"2024-04-25T13:47:24.254373+0000","last_peered":"2024-04-25T13:47:24.254373+0000","last_clean":"2024-04-25T13:47:24.254373+0000","last_became_active":"2024-04-25T13:41:04.429404+0000","last_became_peered":"2024-04-25T13:41:04.429404+0000","last_unstale":"2024-04-25T13:47:24.254373+0000","last_undegraded":"2024-04-25T13:47:24.254373+0000","last_fullsized":"2024-04-25T13:47:24.254373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'87","last_scrub_stamp":"2024-04-25T13:47:24.254168+0000","last_deep_scrub":"23'87","last_deep_scrub_stamp":"2024-04-25T13:47:24.254168+0000","last_clean_scrub_stamp":"2024-04-25T13:47:24.254168+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:06.571981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'107","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:14.441955+0000","last_change":"2024-04-25T13:47:14.441982+0000","last_active":"2024-04-25T13:47:14.441955+0000","last_peered":"2024-04-25T13:47:14.441955+0000","last_clean":"2024-04-25T13:47:14.441955+0000","last_became_active":"2024-04-25T13:41:03.414957+0000","last_became_peered":"2024-04-25T13:41:03.414957+0000","last_unstale":"2024-04-25T13:47:14.441955+0000","last_undegraded":"2024-04-25T13:47:14.441955+0000","last_fullsized":"2024-04-25T13:47:14.441955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'107","last_scrub_stamp":"2024-04-25T13:47:14.441887+0000","last_deep_scrub":"23'107","last_deep_scrub_stamp":"2024-04-25T13:47:14.441887+0000","last_clean_scrub_stamp":"2024-04-25T13:47:14.441887+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:07.428202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'75","reported_seq":102,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:27.226380+0000","last_change":"2024-04-25T13:47:27.226451+0000","last_active":"2024-04-25T13:47:27.226380+0000","last_peered":"2024-04-25T13:47:27.226380+0000","last_clean":"2024-04-25T13:47:27.226380+0000","last_became_active":"2024-04-25T13:41:04.434194+0000","last_became_peered":"2024-04-25T13:41:04.434194+0000","last_unstale":"2024-04-25T13:47:27.226380+0000","last_undegraded":"2024-04-25T13:47:27.226380+0000","last_fullsized":"2024-04-25T13:47:27.226380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'75","last_scrub_stamp":"2024-04-25T13:47:27.226161+0000","last_deep_scrub":"23'75","last_deep_scrub_stamp":"2024-04-25T13:47:27.226161+0000","last_clean_scrub_stamp":"2024-04-25T13:47:27.226161+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:33.584949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'578","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:12.976909+0000","last_change":"2024-04-25T13:47:12.976958+0000","last_active":"2024-04-25T13:47:12.976909+0000","last_peered":"2024-04-25T13:47:12.976909+0000","last_clean":"2024-04-25T13:47:12.976909+0000","last_became_active":"2024-04-25T13:41:03.401398+0000","last_became_peered":"2024-04-25T13:41:03.401398+0000","last_unstale":"2024-04-25T13:47:12.976909+0000","last_undegraded":"2024-04-25T13:47:12.976909+0000","last_fullsized":"2024-04-25T13:47:12.976909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'578","last_scrub_stamp":"2024-04-25T13:47:12.976786+0000","last_deep_scrub":"23'578","last_deep_scrub_stamp":"2024-04-25T13:47:12.976786+0000","last_clean_scrub_stamp":"2024-04-25T13:47:12.976786+0000","objects_scrubbed":2,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:21.404647+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":4320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'92","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:21.283313+0000","last_change":"2024-04-25T13:47:21.283484+0000","last_active":"2024-04-25T13:47:21.283313+0000","last_peered":"2024-04-25T13:47:21.283313+0000","last_clean":"2024-04-25T13:47:21.283313+0000","last_became_active":"2024-04-25T13:41:04.417963+0000","last_became_peered":"2024-04-25T13:41:04.417963+0000","last_unstale":"2024-04-25T13:47:21.283313+0000","last_undegraded":"2024-04-25T13:47:21.283313+0000","last_fullsized":"2024-04-25T13:47:21.283313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'92","last_scrub_stamp":"2024-04-25T13:47:21.283015+0000","last_deep_scrub":"23'92","last_deep_scrub_stamp":"2024-04-25T13:47:21.283015+0000","last_clean_scrub_stamp":"2024-04-25T13:47:21.283015+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:09.195321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"23'134","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:16.498153+0000","last_change":"2024-04-25T13:47:16.498255+0000","last_active":"2024-04-25T13:47:16.498153+0000","last_peered":"2024-04-25T13:47:16.498153+0000","last_clean":"2024-04-25T13:47:16.498153+0000","last_became_active":"2024-04-25T13:41:03.445293+0000","last_became_peered":"2024-04-25T13:41:03.445293+0000","last_unstale":"2024-04-25T13:47:16.498153+0000","last_undegraded":"2024-04-25T13:47:16.498153+0000","last_fullsized":"2024-04-25T13:47:16.498153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-04-25T13:47:16.497948+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-04-25T13:47:16.497948+0000","last_clean_scrub_stamp":"2024-04-25T13:47:16.497948+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:20.607313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'92","reported_seq":124,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:31.147850+0000","last_change":"2024-04-25T13:47:31.147942+0000","last_active":"2024-04-25T13:47:31.147850+0000","last_peered":"2024-04-25T13:47:31.147850+0000","last_clean":"2024-04-25T13:47:31.147850+0000","last_became_active":"2024-04-25T13:41:51.965867+0000","last_became_peered":"2024-04-25T13:41:51.965867+0000","last_unstale":"2024-04-25T13:47:31.147850+0000","last_undegraded":"2024-04-25T13:47:31.147850+0000","last_fullsized":"2024-04-25T13:47:31.147850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'92","last_scrub_stamp":"2024-04-25T13:47:31.147639+0000","last_deep_scrub":"23'92","last_deep_scrub_stamp":"2024-04-25T13:47:31.147639+0000","last_clean_scrub_stamp":"2024-04-25T13:47:31.147639+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:59.389100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'74","reported_seq":128,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:16.335340+0000","last_change":"2024-04-25T13:47:16.335427+0000","last_active":"2024-04-25T13:47:16.335340+0000","last_peered":"2024-04-25T13:47:16.335340+0000","last_clean":"2024-04-25T13:47:16.335340+0000","last_became_active":"2024-04-25T13:41:00.172906+0000","last_became_peered":"2024-04-25T13:41:00.172906+0000","last_unstale":"2024-04-25T13:47:16.335340+0000","last_undegraded":"2024-04-25T13:47:16.335340+0000","last_fullsized":"2024-04-25T13:47:16.335340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-04-25T13:47:16.335146+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-04-25T13:47:16.335146+0000","last_clean_scrub_stamp":"2024-04-25T13:47:16.335146+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:03.039338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'122","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:14.248477+0000","last_change":"2024-04-25T13:47:14.248477+0000","last_active":"2024-04-25T13:47:14.248477+0000","last_peered":"2024-04-25T13:47:14.248477+0000","last_clean":"2024-04-25T13:47:14.248477+0000","last_became_active":"2024-04-25T13:41:03.437569+0000","last_became_peered":"2024-04-25T13:41:03.437569+0000","last_unstale":"2024-04-25T13:47:14.248477+0000","last_undegraded":"2024-04-25T13:47:14.248477+0000","last_fullsized":"2024-04-25T13:47:14.248477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'122","last_scrub_stamp":"2024-04-25T13:47:14.248209+0000","last_deep_scrub":"23'122","last_deep_scrub_stamp":"2024-04-25T13:47:14.248209+0000","last_clean_scrub_stamp":"2024-04-25T13:47:14.248209+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:53.861020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'75","reported_seq":103,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:20.755445+0000","last_change":"2024-04-25T13:47:20.755445+0000","last_active":"2024-04-25T13:47:20.755445+0000","last_peered":"2024-04-25T13:47:20.755445+0000","last_clean":"2024-04-25T13:47:20.755445+0000","last_became_active":"2024-04-25T13:41:04.416666+0000","last_became_peered":"2024-04-25T13:41:04.416666+0000","last_unstale":"2024-04-25T13:47:20.755445+0000","last_undegraded":"2024-04-25T13:47:20.755445+0000","last_fullsized":"2024-04-25T13:47:20.755445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'75","last_scrub_stamp":"2024-04-25T13:47:20.754963+0000","last_deep_scrub":"23'75","last_deep_scrub_stamp":"2024-04-25T13:47:20.754963+0000","last_clean_scrub_stamp":"2024-04-25T13:47:20.754963+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:44.907314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'1395","reported_seq":1425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:20.343859+0000","last_change":"2024-04-25T13:47:20.343937+0000","last_active":"2024-04-25T13:47:20.343859+0000","last_peered":"2024-04-25T13:47:20.343859+0000","last_clean":"2024-04-25T13:47:20.343859+0000","last_became_active":"2024-04-25T13:41:03.429200+0000","last_became_peered":"2024-04-25T13:41:03.429200+0000","last_unstale":"2024-04-25T13:47:20.343859+0000","last_undegraded":"2024-04-25T13:47:20.343859+0000","last_fullsized":"2024-04-25T13:47:20.343859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1395","last_scrub_stamp":"2024-04-25T13:47:20.343637+0000","last_deep_scrub":"23'1395","last_deep_scrub_stamp":"2024-04-25T13:47:20.343637+0000","last_clean_scrub_stamp":"2024-04-25T13:47:20.343637+0000","objects_scrubbed":2,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:38.969868+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1260,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'77","reported_seq":105,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:15.473150+0000","last_change":"2024-04-25T13:47:15.473150+0000","last_active":"2024-04-25T13:47:15.473150+0000","last_peered":"2024-04-25T13:47:15.473150+0000","last_clean":"2024-04-25T13:47:15.473150+0000","last_became_active":"2024-04-25T13:41:04.400093+0000","last_became_peered":"2024-04-25T13:41:04.400093+0000","last_unstale":"2024-04-25T13:47:15.473150+0000","last_undegraded":"2024-04-25T13:47:15.473150+0000","last_fullsized":"2024-04-25T13:47:15.473150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'77","last_scrub_stamp":"2024-04-25T13:47:15.472902+0000","last_deep_scrub":"23'77","last_deep_scrub_stamp":"2024-04-25T13:47:15.472902+0000","last_clean_scrub_stamp":"2024-04-25T13:47:15.472902+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:18.109208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'426","reported_seq":761,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:15.459065+0000","last_change":"2024-04-25T13:47:15.459065+0000","last_active":"2024-04-25T13:47:15.459065+0000","last_peered":"2024-04-25T13:47:15.459065+0000","last_clean":"2024-04-25T13:47:15.459065+0000","last_became_active":"2024-04-25T13:41:03.414899+0000","last_became_peered":"2024-04-25T13:41:03.414899+0000","last_unstale":"2024-04-25T13:47:15.459065+0000","last_undegraded":"2024-04-25T13:47:15.459065+0000","last_fullsized":"2024-04-25T13:47:15.459065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'426","last_scrub_stamp":"2024-04-25T13:47:15.458799+0000","last_deep_scrub":"23'426","last_deep_scrub_stamp":"2024-04-25T13:47:15.458799+0000","last_clean_scrub_stamp":"2024-04-25T13:47:15.458799+0000","objects_scrubbed":1,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:58.122958+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":769923,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":305,"num_write_kb":953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'94","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:20.047693+0000","last_change":"2024-04-25T13:47:20.047759+0000","last_active":"2024-04-25T13:47:20.047693+0000","last_peered":"2024-04-25T13:47:20.047693+0000","last_clean":"2024-04-25T13:47:20.047693+0000","last_became_active":"2024-04-25T13:41:04.402055+0000","last_became_peered":"2024-04-25T13:41:04.402055+0000","last_unstale":"2024-04-25T13:47:20.047693+0000","last_undegraded":"2024-04-25T13:47:20.047693+0000","last_fullsized":"2024-04-25T13:47:20.047693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'94","last_scrub_stamp":"2024-04-25T13:47:20.047490+0000","last_deep_scrub":"23'94","last_deep_scrub_stamp":"2024-04-25T13:47:20.047490+0000","last_clean_scrub_stamp":"2024-04-25T13:47:20.047490+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.471391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1423","reported_seq":1453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:17.278603+0000","last_change":"2024-04-25T13:47:17.278603+0000","last_active":"2024-04-25T13:47:17.278603+0000","last_peered":"2024-04-25T13:47:17.278603+0000","last_clean":"2024-04-25T13:47:17.278603+0000","last_became_active":"2024-04-25T13:41:03.444429+0000","last_became_peered":"2024-04-25T13:41:03.444429+0000","last_unstale":"2024-04-25T13:47:17.278603+0000","last_undegraded":"2024-04-25T13:47:17.278603+0000","last_fullsized":"2024-04-25T13:47:17.278603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1423","last_scrub_stamp":"2024-04-25T13:47:17.278318+0000","last_deep_scrub":"23'1423","last_deep_scrub_stamp":"2024-04-25T13:47:17.278318+0000","last_clean_scrub_stamp":"2024-04-25T13:47:17.278318+0000","objects_scrubbed":2,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:15.514637+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":8954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'79","reported_seq":107,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:15.078036+0000","last_change":"2024-04-25T13:47:15.078036+0000","last_active":"2024-04-25T13:47:15.078036+0000","last_peered":"2024-04-25T13:47:15.078036+0000","last_clean":"2024-04-25T13:47:15.078036+0000","last_became_active":"2024-04-25T13:41:04.398287+0000","last_became_peered":"2024-04-25T13:41:04.398287+0000","last_unstale":"2024-04-25T13:47:15.078036+0000","last_undegraded":"2024-04-25T13:47:15.078036+0000","last_fullsized":"2024-04-25T13:47:15.078036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'79","last_scrub_stamp":"2024-04-25T13:47:15.077625+0000","last_deep_scrub":"23'79","last_deep_scrub_stamp":"2024-04-25T13:47:15.077625+0000","last_clean_scrub_stamp":"2024-04-25T13:47:15.077625+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:27.036935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'115","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:15.948454+0000","last_change":"2024-04-25T13:47:15.948454+0000","last_active":"2024-04-25T13:47:15.948454+0000","last_peered":"2024-04-25T13:47:15.948454+0000","last_clean":"2024-04-25T13:47:15.948454+0000","last_became_active":"2024-04-25T13:41:03.414145+0000","last_became_peered":"2024-04-25T13:41:03.414145+0000","last_unstale":"2024-04-25T13:47:15.948454+0000","last_undegraded":"2024-04-25T13:47:15.948454+0000","last_fullsized":"2024-04-25T13:47:15.948454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'115","last_scrub_stamp":"2024-04-25T13:47:15.948165+0000","last_deep_scrub":"23'115","last_deep_scrub_stamp":"2024-04-25T13:47:15.948165+0000","last_clean_scrub_stamp":"2024-04-25T13:47:15.948165+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:08.495420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'92","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:22.246990+0000","last_change":"2024-04-25T13:47:22.246990+0000","last_active":"2024-04-25T13:47:22.246990+0000","last_peered":"2024-04-25T13:47:22.246990+0000","last_clean":"2024-04-25T13:47:22.246990+0000","last_became_active":"2024-04-25T13:41:04.417831+0000","last_became_peered":"2024-04-25T13:41:04.417831+0000","last_unstale":"2024-04-25T13:47:22.246990+0000","last_undegraded":"2024-04-25T13:47:22.246990+0000","last_fullsized":"2024-04-25T13:47:22.246990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'92","last_scrub_stamp":"2024-04-25T13:47:22.246726+0000","last_deep_scrub":"23'92","last_deep_scrub_stamp":"2024-04-25T13:47:22.246726+0000","last_clean_scrub_stamp":"2024-04-25T13:47:22.246726+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:23.495116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'105","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:17.313581+0000","last_change":"2024-04-25T13:47:17.313581+0000","last_active":"2024-04-25T13:47:17.313581+0000","last_peered":"2024-04-25T13:47:17.313581+0000","last_clean":"2024-04-25T13:47:17.313581+0000","last_became_active":"2024-04-25T13:41:03.423176+0000","last_became_peered":"2024-04-25T13:41:03.423176+0000","last_unstale":"2024-04-25T13:47:17.313581+0000","last_undegraded":"2024-04-25T13:47:17.313581+0000","last_fullsized":"2024-04-25T13:47:17.313581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'105","last_scrub_stamp":"2024-04-25T13:47:17.313303+0000","last_deep_scrub":"23'105","last_deep_scrub_stamp":"2024-04-25T13:47:17.313303+0000","last_clean_scrub_stamp":"2024-04-25T13:47:17.313303+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:26.733476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'78","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:19.040490+0000","last_change":"2024-04-25T13:47:19.040490+0000","last_active":"2024-04-25T13:47:19.040490+0000","last_peered":"2024-04-25T13:47:19.040490+0000","last_clean":"2024-04-25T13:47:19.040490+0000","last_became_active":"2024-04-25T13:41:04.402014+0000","last_became_peered":"2024-04-25T13:41:04.402014+0000","last_unstale":"2024-04-25T13:47:19.040490+0000","last_undegraded":"2024-04-25T13:47:19.040490+0000","last_fullsized":"2024-04-25T13:47:19.040490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'78","last_scrub_stamp":"2024-04-25T13:47:19.040037+0000","last_deep_scrub":"23'78","last_deep_scrub_stamp":"2024-04-25T13:47:19.040037+0000","last_clean_scrub_stamp":"2024-04-25T13:47:19.040037+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:33.859301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'359","reported_seq":389,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:16.999297+0000","last_change":"2024-04-25T13:47:16.999297+0000","last_active":"2024-04-25T13:47:16.999297+0000","last_peered":"2024-04-25T13:47:16.999297+0000","last_clean":"2024-04-25T13:47:16.999297+0000","last_became_active":"2024-04-25T13:41:03.439074+0000","last_became_peered":"2024-04-25T13:41:03.439074+0000","last_unstale":"2024-04-25T13:47:16.999297+0000","last_undegraded":"2024-04-25T13:47:16.999297+0000","last_fullsized":"2024-04-25T13:47:16.999297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'359","last_scrub_stamp":"2024-04-25T13:47:16.998888+0000","last_deep_scrub":"23'359","last_deep_scrub_stamp":"2024-04-25T13:47:16.998888+0000","last_clean_scrub_stamp":"2024-04-25T13:47:16.998888+0000","objects_scrubbed":1,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:01.026140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'79","reported_seq":106,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:21.744668+0000","last_change":"2024-04-25T13:47:21.744735+0000","last_active":"2024-04-25T13:47:21.744668+0000","last_peered":"2024-04-25T13:47:21.744668+0000","last_clean":"2024-04-25T13:47:21.744668+0000","last_became_active":"2024-04-25T13:41:04.418330+0000","last_became_peered":"2024-04-25T13:41:04.418330+0000","last_unstale":"2024-04-25T13:47:21.744668+0000","last_undegraded":"2024-04-25T13:47:21.744668+0000","last_fullsized":"2024-04-25T13:47:21.744668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'79","last_scrub_stamp":"2024-04-25T13:47:21.744454+0000","last_deep_scrub":"23'79","last_deep_scrub_stamp":"2024-04-25T13:47:21.744454+0000","last_clean_scrub_stamp":"2024-04-25T13:47:21.744454+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:25.689607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'121","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:18.384821+0000","last_change":"2024-04-25T13:47:18.384821+0000","last_active":"2024-04-25T13:47:18.384821+0000","last_peered":"2024-04-25T13:47:18.384821+0000","last_clean":"2024-04-25T13:47:18.384821+0000","last_became_active":"2024-04-25T13:41:03.434870+0000","last_became_peered":"2024-04-25T13:41:03.434870+0000","last_unstale":"2024-04-25T13:47:18.384821+0000","last_undegraded":"2024-04-25T13:47:18.384821+0000","last_fullsized":"2024-04-25T13:47:18.384821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'121","last_scrub_stamp":"2024-04-25T13:47:18.384396+0000","last_deep_scrub":"23'121","last_deep_scrub_stamp":"2024-04-25T13:47:18.384396+0000","last_clean_scrub_stamp":"2024-04-25T13:47:18.384396+0000","objects_scrubbed":1,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:21.020702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'88","reported_seq":115,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:21.463752+0000","last_change":"2024-04-25T13:47:21.463828+0000","last_active":"2024-04-25T13:47:21.463752+0000","last_peered":"2024-04-25T13:47:21.463752+0000","last_clean":"2024-04-25T13:47:21.463752+0000","last_became_active":"2024-04-25T13:41:04.426424+0000","last_became_peered":"2024-04-25T13:41:04.426424+0000","last_unstale":"2024-04-25T13:47:21.463752+0000","last_undegraded":"2024-04-25T13:47:21.463752+0000","last_fullsized":"2024-04-25T13:47:21.463752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'88","last_scrub_stamp":"2024-04-25T13:47:21.463506+0000","last_deep_scrub":"23'88","last_deep_scrub_stamp":"2024-04-25T13:47:21.463506+0000","last_clean_scrub_stamp":"2024-04-25T13:47:21.463506+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:45.615857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'655","reported_seq":685,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:18.315521+0000","last_change":"2024-04-25T13:47:18.315521+0000","last_active":"2024-04-25T13:47:18.315521+0000","last_peered":"2024-04-25T13:47:18.315521+0000","last_clean":"2024-04-25T13:47:18.315521+0000","last_became_active":"2024-04-25T13:41:03.429094+0000","last_became_peered":"2024-04-25T13:41:03.429094+0000","last_unstale":"2024-04-25T13:47:18.315521+0000","last_undegraded":"2024-04-25T13:47:18.315521+0000","last_fullsized":"2024-04-25T13:47:18.315521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'655","last_scrub_stamp":"2024-04-25T13:47:18.315231+0000","last_deep_scrub":"23'655","last_deep_scrub_stamp":"2024-04-25T13:47:18.315231+0000","last_clean_scrub_stamp":"2024-04-25T13:47:18.315231+0000","objects_scrubbed":1,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:16.551550+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'81","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:18.090527+0000","last_change":"2024-04-25T13:47:18.090594+0000","last_active":"2024-04-25T13:47:18.090527+0000","last_peered":"2024-04-25T13:47:18.090527+0000","last_clean":"2024-04-25T13:47:18.090527+0000","last_became_active":"2024-04-25T13:41:04.412572+0000","last_became_peered":"2024-04-25T13:41:04.412572+0000","last_unstale":"2024-04-25T13:47:18.090527+0000","last_undegraded":"2024-04-25T13:47:18.090527+0000","last_fullsized":"2024-04-25T13:47:18.090527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'81","last_scrub_stamp":"2024-04-25T13:47:18.090324+0000","last_deep_scrub":"23'81","last_deep_scrub_stamp":"2024-04-25T13:47:18.090324+0000","last_clean_scrub_stamp":"2024-04-25T13:47:18.090324+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:07.726209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'126","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:14.984826+0000","last_change":"2024-04-25T13:47:14.984826+0000","last_active":"2024-04-25T13:47:14.984826+0000","last_peered":"2024-04-25T13:47:14.984826+0000","last_clean":"2024-04-25T13:47:14.984826+0000","last_became_active":"2024-04-25T13:41:03.411481+0000","last_became_peered":"2024-04-25T13:41:03.411481+0000","last_unstale":"2024-04-25T13:47:14.984826+0000","last_undegraded":"2024-04-25T13:47:14.984826+0000","last_fullsized":"2024-04-25T13:47:14.984826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'126","last_scrub_stamp":"2024-04-25T13:47:14.984438+0000","last_deep_scrub":"23'126","last_deep_scrub_stamp":"2024-04-25T13:47:14.984438+0000","last_clean_scrub_stamp":"2024-04-25T13:47:14.984438+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:13.325726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'90","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:16.816059+0000","last_change":"2024-04-25T13:47:16.816138+0000","last_active":"2024-04-25T13:47:16.816059+0000","last_peered":"2024-04-25T13:47:16.816059+0000","last_clean":"2024-04-25T13:47:16.816059+0000","last_became_active":"2024-04-25T13:41:04.408517+0000","last_became_peered":"2024-04-25T13:41:04.408517+0000","last_unstale":"2024-04-25T13:47:16.816059+0000","last_undegraded":"2024-04-25T13:47:16.816059+0000","last_fullsized":"2024-04-25T13:47:16.816059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'90","last_scrub_stamp":"2024-04-25T13:47:16.815827+0000","last_deep_scrub":"23'90","last_deep_scrub_stamp":"2024-04-25T13:47:16.815827+0000","last_clean_scrub_stamp":"2024-04-25T13:47:16.815827+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:18:48.729029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'128","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:13.967137+0000","last_change":"2024-04-25T13:47:13.967137+0000","last_active":"2024-04-25T13:47:13.967137+0000","last_peered":"2024-04-25T13:47:13.967137+0000","last_clean":"2024-04-25T13:47:13.967137+0000","last_became_active":"2024-04-25T13:41:03.407713+0000","last_became_peered":"2024-04-25T13:41:03.407713+0000","last_unstale":"2024-04-25T13:47:13.967137+0000","last_undegraded":"2024-04-25T13:47:13.967137+0000","last_fullsized":"2024-04-25T13:47:13.967137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'128","last_scrub_stamp":"2024-04-25T13:47:13.967033+0000","last_deep_scrub":"23'128","last_deep_scrub_stamp":"2024-04-25T13:47:13.967033+0000","last_clean_scrub_stamp":"2024-04-25T13:47:13.967033+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:22.490205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'94","reported_seq":121,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:25.682067+0000","last_change":"2024-04-25T13:47:25.682138+0000","last_active":"2024-04-25T13:47:25.682067+0000","last_peered":"2024-04-25T13:47:25.682067+0000","last_clean":"2024-04-25T13:47:25.682067+0000","last_became_active":"2024-04-25T13:41:04.424153+0000","last_became_peered":"2024-04-25T13:41:04.424153+0000","last_unstale":"2024-04-25T13:47:25.682067+0000","last_undegraded":"2024-04-25T13:47:25.682067+0000","last_fullsized":"2024-04-25T13:47:25.682067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'94","last_scrub_stamp":"2024-04-25T13:47:25.681859+0000","last_deep_scrub":"23'94","last_deep_scrub_stamp":"2024-04-25T13:47:25.681859+0000","last_clean_scrub_stamp":"2024-04-25T13:47:25.681859+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:07.999673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'578","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:19.290187+0000","last_change":"2024-04-25T13:47:19.290279+0000","last_active":"2024-04-25T13:47:19.290187+0000","last_peered":"2024-04-25T13:47:19.290187+0000","last_clean":"2024-04-25T13:47:19.290187+0000","last_became_active":"2024-04-25T13:41:03.430716+0000","last_became_peered":"2024-04-25T13:41:03.430716+0000","last_unstale":"2024-04-25T13:47:19.290187+0000","last_undegraded":"2024-04-25T13:47:19.290187+0000","last_fullsized":"2024-04-25T13:47:19.290187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'578","last_scrub_stamp":"2024-04-25T13:47:19.289917+0000","last_deep_scrub":"23'578","last_deep_scrub_stamp":"2024-04-25T13:47:19.289917+0000","last_clean_scrub_stamp":"2024-04-25T13:47:19.289917+0000","objects_scrubbed":2,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:43.442268+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'75","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:23.306180+0000","last_change":"2024-04-25T13:47:23.306249+0000","last_active":"2024-04-25T13:47:23.306180+0000","last_peered":"2024-04-25T13:47:23.306180+0000","last_clean":"2024-04-25T13:47:23.306180+0000","last_became_active":"2024-04-25T13:41:04.424248+0000","last_became_peered":"2024-04-25T13:41:04.424248+0000","last_unstale":"2024-04-25T13:47:23.306180+0000","last_undegraded":"2024-04-25T13:47:23.306180+0000","last_fullsized":"2024-04-25T13:47:23.306180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'75","last_scrub_stamp":"2024-04-25T13:47:23.305939+0000","last_deep_scrub":"23'75","last_deep_scrub_stamp":"2024-04-25T13:47:23.305939+0000","last_clean_scrub_stamp":"2024-04-25T13:47:23.305939+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:54.729840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'77","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:25.255659+0000","last_change":"2024-04-25T13:47:25.255736+0000","last_active":"2024-04-25T13:47:25.255659+0000","last_peered":"2024-04-25T13:47:25.255659+0000","last_clean":"2024-04-25T13:47:25.255659+0000","last_became_active":"2024-04-25T13:41:04.424475+0000","last_became_peered":"2024-04-25T13:41:04.424475+0000","last_unstale":"2024-04-25T13:47:25.255659+0000","last_undegraded":"2024-04-25T13:47:25.255659+0000","last_fullsized":"2024-04-25T13:47:25.255659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'77","last_scrub_stamp":"2024-04-25T13:47:25.255453+0000","last_deep_scrub":"23'77","last_deep_scrub_stamp":"2024-04-25T13:47:25.255453+0000","last_clean_scrub_stamp":"2024-04-25T13:47:25.255453+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:15.935174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'114","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:22.324061+0000","last_change":"2024-04-25T13:47:22.324136+0000","last_active":"2024-04-25T13:47:22.324061+0000","last_peered":"2024-04-25T13:47:22.324061+0000","last_clean":"2024-04-25T13:47:22.324061+0000","last_became_active":"2024-04-25T13:41:03.446522+0000","last_became_peered":"2024-04-25T13:41:03.446522+0000","last_unstale":"2024-04-25T13:47:22.324061+0000","last_undegraded":"2024-04-25T13:47:22.324061+0000","last_fullsized":"2024-04-25T13:47:22.324061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'114","last_scrub_stamp":"2024-04-25T13:47:22.323857+0000","last_deep_scrub":"23'114","last_deep_scrub_stamp":"2024-04-25T13:47:22.323857+0000","last_clean_scrub_stamp":"2024-04-25T13:47:22.323857+0000","objects_scrubbed":1,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:24.202792+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'74","reported_seq":101,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:24.264051+0000","last_change":"2024-04-25T13:47:24.264123+0000","last_active":"2024-04-25T13:47:24.264051+0000","last_peered":"2024-04-25T13:47:24.264051+0000","last_clean":"2024-04-25T13:47:24.264051+0000","last_became_active":"2024-04-25T13:41:04.423899+0000","last_became_peered":"2024-04-25T13:41:04.423899+0000","last_unstale":"2024-04-25T13:47:24.264051+0000","last_undegraded":"2024-04-25T13:47:24.264051+0000","last_fullsized":"2024-04-25T13:47:24.264051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-04-25T13:47:24.263842+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-04-25T13:47:24.263842+0000","last_clean_scrub_stamp":"2024-04-25T13:47:24.263842+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:48.048671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'995","reported_seq":1024,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:21.349932+0000","last_change":"2024-04-25T13:47:21.350017+0000","last_active":"2024-04-25T13:47:21.349932+0000","last_peered":"2024-04-25T13:47:21.349932+0000","last_clean":"2024-04-25T13:47:21.349932+0000","last_became_active":"2024-04-25T13:41:03.440886+0000","last_became_peered":"2024-04-25T13:41:03.440886+0000","last_unstale":"2024-04-25T13:47:21.349932+0000","last_undegraded":"2024-04-25T13:47:21.349932+0000","last_fullsized":"2024-04-25T13:47:21.349932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'995","last_scrub_stamp":"2024-04-25T13:47:21.349711+0000","last_deep_scrub":"23'995","last_deep_scrub_stamp":"2024-04-25T13:47:21.349711+0000","last_clean_scrub_stamp":"2024-04-25T13:47:21.349711+0000","objects_scrubbed":3,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:28:40.564487+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":8413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'76","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:18.491477+0000","last_change":"2024-04-25T13:47:18.491477+0000","last_active":"2024-04-25T13:47:18.491477+0000","last_peered":"2024-04-25T13:47:18.491477+0000","last_clean":"2024-04-25T13:47:18.491477+0000","last_became_active":"2024-04-25T13:41:04.422496+0000","last_became_peered":"2024-04-25T13:41:04.422496+0000","last_unstale":"2024-04-25T13:47:18.491477+0000","last_undegraded":"2024-04-25T13:47:18.491477+0000","last_fullsized":"2024-04-25T13:47:18.491477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'76","last_scrub_stamp":"2024-04-25T13:47:18.491198+0000","last_deep_scrub":"23'76","last_deep_scrub_stamp":"2024-04-25T13:47:18.491198+0000","last_clean_scrub_stamp":"2024-04-25T13:47:18.491198+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:28.093074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'431","reported_seq":461,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:13.872350+0000","last_change":"2024-04-25T13:47:13.872380+0000","last_active":"2024-04-25T13:47:13.872350+0000","last_peered":"2024-04-25T13:47:13.872350+0000","last_clean":"2024-04-25T13:47:13.872350+0000","last_became_active":"2024-04-25T13:41:03.417592+0000","last_became_peered":"2024-04-25T13:41:03.417592+0000","last_unstale":"2024-04-25T13:47:13.872350+0000","last_undegraded":"2024-04-25T13:47:13.872350+0000","last_fullsized":"2024-04-25T13:47:13.872350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'431","last_scrub_stamp":"2024-04-25T13:47:13.872270+0000","last_deep_scrub":"23'431","last_deep_scrub_stamp":"2024-04-25T13:47:13.872270+0000","last_clean_scrub_stamp":"2024-04-25T13:47:13.872270+0000","objects_scrubbed":1,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:48:12.213558+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":4217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'82","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:17.794023+0000","last_change":"2024-04-25T13:47:17.794096+0000","last_active":"2024-04-25T13:47:17.794023+0000","last_peered":"2024-04-25T13:47:17.794023+0000","last_clean":"2024-04-25T13:47:17.794023+0000","last_became_active":"2024-04-25T13:41:04.410065+0000","last_became_peered":"2024-04-25T13:41:04.410065+0000","last_unstale":"2024-04-25T13:47:17.794023+0000","last_undegraded":"2024-04-25T13:47:17.794023+0000","last_fullsized":"2024-04-25T13:47:17.794023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'82","last_scrub_stamp":"2024-04-25T13:47:17.793802+0000","last_deep_scrub":"23'82","last_deep_scrub_stamp":"2024-04-25T13:47:17.793802+0000","last_clean_scrub_stamp":"2024-04-25T13:47:17.793802+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:27.395678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'438","reported_seq":468,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T13:47:13.451397+0000","last_change":"2024-04-25T13:47:13.451397+0000","last_active":"2024-04-25T13:47:13.451397+0000","last_peered":"2024-04-25T13:47:13.451397+0000","last_clean":"2024-04-25T13:47:13.451397+0000","last_became_active":"2024-04-25T13:41:03.424688+0000","last_became_peered":"2024-04-25T13:41:03.424688+0000","last_unstale":"2024-04-25T13:47:13.451397+0000","last_undegraded":"2024-04-25T13:47:13.451397+0000","last_fullsized":"2024-04-25T13:47:13.451397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'438","last_scrub_stamp":"2024-04-25T13:47:13.450942+0000","last_deep_scrub":"23'438","last_deep_scrub_stamp":"2024-04-25T13:47:13.450942+0000","last_clean_scrub_stamp":"2024-04-25T13:47:13.450942+0000","objects_scrubbed":3,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:21.974115+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75674842,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":305,"num_read_kb":953,"num_write":10892,"num_write_kb":79992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113328128,"data_stored":151349684,"data_compressed":10339548,"data_compressed_allocated":20144128,"data_compressed_original":58220544,"omap_allocated":0,"internal_metadata":0},"log_size":14491,"ondisk_log_size":14491,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66492,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95428,"kb_used_data":23996,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94276412,"statfs":{"total":96636764160,"available":96539045888,"internally_reserved":0,"allocated":24571904,"data_stored":34233256,"data_compressed":2467561,"data_compressed_allocated":4726784,"data_compressed_original":14548992,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50572,"kb_used_data":11076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321268,"statfs":{"total":96636764160,"available":96584978432,"internally_reserved":0,"allocated":11341824,"data_stored":16865762,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58792,"kb_used_data":13728,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94313048,"statfs":{"total":96636764160,"available":96576561152,"internally_reserved":0,"allocated":14057472,"data_stored":16271157,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89060,"kb_used_data":21788,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94282780,"statfs":{"total":96636764160,"available":96545566720,"internally_reserved":0,"allocated":22310912,"data_stored":28854105,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53672,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94318168,"statfs":{"total":96636764160,"available":96581804032,"internally_reserved":0,"allocated":10256384,"data_stored":13441381,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":857797,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65576,"kb_used_data":16352,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94306264,"statfs":{"total":96636764160,"available":96569614336,"internally_reserved":0,"allocated":16744448,"data_stored":21059554,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":14784,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":15138816,"data_stored":21650400,"data_compressed":1741521,"data_compressed_allocated":3354624,"data_compressed_original":10035200,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33246,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":20972158,"data_compressed":1708275,"data_compressed_allocated":3309568,"data_compressed_original":9461760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16502784,"data_stored":20971680,"data_compressed":1018558,"data_compressed_allocated":1818624,"data_compressed_original":6295552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":769923,"data_compressed":12537,"data_compressed_allocated":32768,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10014720,"data_stored":13353507,"data_compressed":1105631,"data_compressed_allocated":2392064,"data_compressed_original":5738496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":28766231,"data_compressed":1863311,"data_compressed_allocated":3600384,"data_compressed_original":10309632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13815808,"data_stored":16183283,"data_compressed":640016,"data_compressed_allocated":1191936,"data_compressed_original":3563520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11100160,"data_stored":16777888,"data_compressed":1556905,"data_compressed_allocated":3117056,"data_compressed_original":8802304,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24264704,"data_stored":33555014,"data_compressed":2434315,"data_compressed_allocated":4681728,"data_compressed_original":13975552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:47:35.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T13:47:36.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21eec15640 1 Processor -- start 2024-04-25T13:47:36.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21eec15640 1 -- start start 2024-04-25T13:47:36.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21eec15640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e806fba0 0x7f21e814f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21eec15640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f21e814fc40 0x7f21e8153870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21eec15640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e80741b0 con 0x7f21e8153db0 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21eec15640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f21e8071b10 con 0x7f21e814fc40 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21eec15640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f21e80bfe40 con 0x7f21e806fba0 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21ed1b2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f21e8153db0 0x7f21e8072e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45938/0 (socket says 172.21.15.77:45938) 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21ed1b2640 1 -- 172.21.15.77:0/3884305000 learned_addr learned my addr 172.21.15.77:0/3884305000 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21ec9b1640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e806fba0 0x7f21e814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e7fff640 1 --2- 172.21.15.77:0/3884305000 >> v2:172.21.15.96:3300/0 conn(0x7f21e814fc40 0x7f21e8153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529690686 0 0) 0x7f21e80741b0 con 0x7f21e8153db0 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d0003530 con 0x7f21e8153db0 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2318490267 0 0) 0x7f21d0003530 con 0x7f21e8153db0 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e806fba0 msgr2=0x7f21e814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e806fba0 0x7f21e814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 >> v2:172.21.15.96:3300/0 conn(0x7f21e814fc40 msgr2=0x7f21e8153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 --2- 172.21.15.77:0/3884305000 >> v2:172.21.15.96:3300/0 conn(0x7f21e814fc40 0x7f21e8153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e8150050 con 0x7f21e8153db0 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f21e0001a00 con 0x7f21e8153db0 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 >> v1:172.21.15.77:6789/0 conn(0x7f21e8153db0 legacy=0x7f21e8072e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0003a30 0x7f21d0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21d0004810 0x7f21d0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e806fba0 0x7f21d0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f21e8071b10 con 0x7f21d0004810 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f21e80bfe40 con 0x7f21d0003a30 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f21d000bad0 con 0x7f21e806fba0 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e7fff640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21d0004810 0x7f21d0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21ec9b1640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0003a30 0x7f21d0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21ed1b2640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e806fba0 0x7f21d0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e7fff640 1 -- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e806fba0 msgr2=0x7f21d0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e7fff640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e806fba0 0x7f21d0005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.145+0000 7f21e7fff640 1 -- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0003a30 msgr2=0x7f21d0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21e7fff640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0003a30 0x7f21d0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21e7fff640 1 -- 172.21.15.77:0/3884305000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d0003530 con 0x7f21d0004810 2024-04-25T13:47:36.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21ec9b1640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0003a30 0x7f21d0003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:47:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21e7fff640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21d0004810 0x7f21d0004c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f21e80710d0 tx=0x7f21dc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7978e92a7c45eaa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0096b0 con 0x7f21d0004810 2024-04-25T13:47:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc0a6430 con 0x7f21d0004810 2024-04-25T13:47:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21e77fe640 1 -- 172.21.15.77:0/3884305000 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0a6820 con 0x7f21d0004810 2024-04-25T13:47:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21eec15640 1 -- 172.21.15.77:0/3884305000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21d0004810 msgr2=0x7f21d0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21eec15640 1 --2- 172.21.15.77:0/3884305000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21d0004810 0x7f21d0004c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f21e80710d0 tx=0x7f21dc01ca50 comp rx=0 tx=0).stop 2024-04-25T13:47:36.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21ed1b2640 1 -- 172.21.15.77:0/3884305000 reap_dead start 2024-04-25T13:47:36.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21eec15640 1 -- 172.21.15.77:0/3884305000 shutdown_connections 2024-04-25T13:47:36.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21eec15640 1 -- 172.21.15.77:0/3884305000 >> 172.21.15.77:0/3884305000 conn(0x7f21e80c3cd0 msgr2=0x7f21e80c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:36.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21eec15640 1 -- 172.21.15.77:0/3884305000 shutdown_connections 2024-04-25T13:47:36.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.149+0000 7f21eec15640 1 -- 172.21.15.77:0/3884305000 wait complete. 2024-04-25T13:47:36.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 Processor -- start 2024-04-25T13:47:36.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 -- start start 2024-04-25T13:47:36.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0004810 0x7f21e8153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e80a3c40 0x7f21e80a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21e80a2650 0x7f21e8148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f21e80a8cc0 con 0x7f21e80a2650 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81545d0 con 0x7f21d0004810 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f21e815bc10 con 0x7f21e80a3c40 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ed1b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21e80a2650 0x7f21e8148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ed1b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21e80a2650 0x7f21e8148b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51322/0 (socket says 172.21.15.77:51322) 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ed1b2640 1 -- 172.21.15.77:0/3210802903 learned_addr learned my addr 172.21.15.77:0/3210802903 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21e7fff640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e80a3c40 0x7f21e80a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ec9b1640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0004810 0x7f21e8153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ed1b2640 1 -- 172.21.15.77:0/3210802903 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e80a3c40 msgr2=0x7f21e80a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ed1b2640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e80a3c40 0x7f21e80a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ed1b2640 1 -- 172.21.15.77:0/3210802903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0004810 msgr2=0x7f21e8153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ed1b2640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0004810 0x7f21e8153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ed1b2640 1 -- 172.21.15.77:0/3210802903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e80a4070 con 0x7f21e80a2650 2024-04-25T13:47:36.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21e7fff640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e80a3c40 0x7f21e80a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:47:36.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21ed1b2640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21e80a2650 0x7f21e8148b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f21d0004790 tx=0x7f21e000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:36.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21e57fa640 1 -- 172.21.15.77:0/3210802903 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0007ae0 con 0x7f21e80a2650 2024-04-25T13:47:36.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21e57fa640 1 -- 172.21.15.77:0/3210802903 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e000eda0 con 0x7f21e80a2650 2024-04-25T13:47:36.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e80a50a0 con 0x7f21e80a2650 2024-04-25T13:47:36.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21e57fa640 1 -- 172.21.15.77:0/3210802903 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0014670 con 0x7f21e80a2650 2024-04-25T13:47:36.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.153+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e81ef850 con 0x7f21e80a2650 2024-04-25T13:47:36.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.157+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e80a4ec0 con 0x7f21e80a2650 2024-04-25T13:47:36.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.157+0000 7f21e57fa640 1 -- 172.21.15.77:0/3210802903 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f21e0014810 con 0x7f21e80a2650 2024-04-25T13:47:36.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.157+0000 7f21e57fa640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f21d406f430 0x7f21d4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.157+0000 7f21e57fa640 1 -- 172.21.15.77:0/3210802903 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f21e008f110 con 0x7f21e80a2650 2024-04-25T13:47:36.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.157+0000 7f21ec9b1640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f21d406f430 0x7f21d4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.157+0000 7f21ec9b1640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f21d406f430 0x7f21d4071940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009160 tx=0x7f21d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:36.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.161+0000 7f21e57fa640 1 -- 172.21.15.77:0/3210802903 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f21e80a4ec0 con 0x7f21e80a2650 2024-04-25T13:47:36.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.321+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f21e806a1a0 con 0x7f21e80a2650 2024-04-25T13:47:36.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21e57fa640 1 -- 172.21.15.77:0/3210802903 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f21e005bef0 con 0x7f21e80a2650 2024-04-25T13:47:36.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21e57fa640 1 -- 172.21.15.77:0/3210802903 <== mon.0 v2:172.21.15.77:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f21e005b300 con 0x7f21e80a2650 2024-04-25T13:47:36.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f21d406f430 msgr2=0x7f21d4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f21d406f430 0x7f21d4071940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009160 tx=0x7f21d8008040 comp rx=0 tx=0).stop 2024-04-25T13:47:36.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21e80a2650 msgr2=0x7f21e8148b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21e80a2650 0x7f21e8148b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f21d0004790 tx=0x7f21e000e530 comp rx=0 tx=0).stop 2024-04-25T13:47:36.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 shutdown_connections 2024-04-25T13:47:36.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f21d406f430 0x7f21d4071940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21e80a2650 0x7f21e8148b90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21e80a3c40 0x7f21e80a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 --2- 172.21.15.77:0/3210802903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d0004810 0x7f21e8153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.329+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 >> 172.21.15.77:0/3210802903 conn(0x7f21e80c3cd0 msgr2=0x7f21e80756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:36.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.333+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 shutdown_connections 2024-04-25T13:47:36.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.333+0000 7f21eec15640 1 -- 172.21.15.77:0/3210802903 wait complete. 2024-04-25T13:47:36.352 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T13:47:36.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:47:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc58ac81640 1 Processor -- start 2024-04-25T13:47:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc58ac81640 1 -- start start 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc58ac81640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc584150cb0 0x7fc58414f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc58ac81640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 0x7fc5840a8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc58ac81640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5841501d0 con 0x7fc5841540c0 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc58ac81640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc5841504b0 con 0x7fc584150cb0 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc58ac81640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc584150790 con 0x7fc58414fc60 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc583fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc584150cb0 0x7fc58414f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc583fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc584150cb0 0x7fc58414f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51330/0 (socket says 172.21.15.77:51330) 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc583fff640 1 -- 172.21.15.77:0/1271703206 learned_addr learned my addr 172.21.15.77:0/1271703206 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc58921e640 1 --2- 172.21.15.77:0/1271703206 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 0x7fc5840a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc583fff640 1 -- 172.21.15.77:0/1271703206 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 msgr2=0x7fc5840a8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc583fff640 1 --2- 172.21.15.77:0/1271703206 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 0x7fc5840a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc583fff640 1 -- 172.21.15.77:0/1271703206 >> v1:172.21.15.96:6789/0 conn(0x7fc5841540c0 legacy=0x7fc58406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:36.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.497+0000 7fc583fff640 1 -- 172.21.15.77:0/1271703206 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5841544d0 con 0x7fc584150cb0 2024-04-25T13:47:36.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc583fff640 1 --2- 172.21.15.77:0/1271703206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 0x7fc58414f720 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc578009870 tx=0x7fc57801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c735402a553d66f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:36.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc5837fe640 1 -- 172.21.15.77:0/1271703206 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b0070 con 0x7fc584150cb0 2024-04-25T13:47:36.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc5837fe640 1 -- 172.21.15.77:0/1271703206 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc5780ab600 con 0x7fc584150cb0 2024-04-25T13:47:36.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc5837fe640 1 -- 172.21.15.77:0/1271703206 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780ab9f0 con 0x7fc584150cb0 2024-04-25T13:47:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 -- 172.21.15.77:0/1271703206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 msgr2=0x7fc58414f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 --2- 172.21.15.77:0/1271703206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 0x7fc58414f720 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc578009870 tx=0x7fc57801c520 comp rx=0 tx=0).stop 2024-04-25T13:47:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 -- 172.21.15.77:0/1271703206 shutdown_connections 2024-04-25T13:47:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 --2- 172.21.15.77:0/1271703206 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 0x7fc5840a8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 --2- 172.21.15.77:0/1271703206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 0x7fc58414f720 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 -- 172.21.15.77:0/1271703206 >> 172.21.15.77:0/1271703206 conn(0x7fc5840c4ae0 msgr2=0x7fc5840c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 -- 172.21.15.77:0/1271703206 shutdown_connections 2024-04-25T13:47:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 -- 172.21.15.77:0/1271703206 wait complete. 2024-04-25T13:47:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 Processor -- start 2024-04-25T13:47:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.501+0000 7fc58ac81640 1 -- start start 2024-04-25T13:47:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58ac81640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 0x7fc584146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58ac81640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 0x7fc584148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58ac81640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5841540c0 0x7fc5841e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58ac81640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5840a9260 con 0x7fc584150cb0 2024-04-25T13:47:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58ac81640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc5840a90e0 con 0x7fc5841540c0 2024-04-25T13:47:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58ac81640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fc5840a93e0 con 0x7fc58414fc60 2024-04-25T13:47:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc583fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 0x7fc584148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc583fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 0x7fc584148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51338/0 (socket says 172.21.15.77:51338) 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc583fff640 1 -- 172.21.15.77:0/2565976827 learned_addr learned my addr 172.21.15.77:0/2565976827 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58921e640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5841540c0 0x7fc5841e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc588a1d640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 0x7fc584146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc583fff640 1 -- 172.21.15.77:0/2565976827 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 msgr2=0x7fc584146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc583fff640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 0x7fc584146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc583fff640 1 -- 172.21.15.77:0/2565976827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5841540c0 msgr2=0x7fc5841e9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc583fff640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5841540c0 0x7fc5841e9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc583fff640 1 -- 172.21.15.77:0/2565976827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc584145760 con 0x7fc584150cb0 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58921e640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5841540c0 0x7fc5841e9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc583fff640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 0x7fc584148180 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc5780ae040 tx=0x7fc5780192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc5817fa640 1 -- 172.21.15.77:0/2565976827 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b0040 con 0x7fc584150cb0 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc5817fa640 1 -- 172.21.15.77:0/2565976827 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc5780b3460 con 0x7fc584150cb0 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc584145a40 con 0x7fc584150cb0 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc5817fa640 1 -- 172.21.15.77:0/2565976827 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b3890 con 0x7fc584150cb0 2024-04-25T13:47:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5841ea0a0 con 0x7fc584150cb0 2024-04-25T13:47:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc58406a280 con 0x7fc584150cb0 2024-04-25T13:47:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc5817fa640 1 -- 172.21.15.77:0/2565976827 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc5780bb020 con 0x7fc584150cb0 2024-04-25T13:47:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc5817fa640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc57006f430 0x7fc570071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc5817fa640 1 -- 172.21.15.77:0/2565976827 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fc578129420 con 0x7fc584150cb0 2024-04-25T13:47:36.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.505+0000 7fc588a1d640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc57006f430 0x7fc570071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.509+0000 7fc588a1d640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc57006f430 0x7fc570071940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc584074ce0 tx=0x7fc574008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:36.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.509+0000 7fc5817fa640 1 -- 172.21.15.77:0/2565976827 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc5780c2020 con 0x7fc584150cb0 2024-04-25T13:47:36.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5840a65d0 con 0x7fc584150cb0 2024-04-25T13:47:36.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc5817fa640 1 -- 172.21.15.77:0/2565976827 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7fc578016110 con 0x7fc584150cb0 2024-04-25T13:47:36.701 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:36.702 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2393103049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2393103049},{"type":"v1","addr":"172.21.15.77:6835","nonce":2393103049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:41:03.799479+0000","modified":"2024-04-25T13:41:06.824136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6833/1035589958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":1035589958},{"type":"v1","addr":"172.21.15.96:6833","nonce":1035589958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-25T13:47:36.702 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-04-25T13:47:36.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc57006f430 msgr2=0x7fc570071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc57006f430 0x7fc570071940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc584074ce0 tx=0x7fc574008040 comp rx=0 tx=0).stop 2024-04-25T13:47:36.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 msgr2=0x7fc584148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 0x7fc584148180 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc5780ae040 tx=0x7fc5780192c0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 shutdown_connections 2024-04-25T13:47:36.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fc57006f430 0x7fc570071940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5841540c0 0x7fc5841e9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc584150cb0 0x7fc584148180 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 --2- 172.21.15.77:0/2565976827 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc58414fc60 0x7fc584146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 >> 172.21.15.77:0/2565976827 conn(0x7fc5840c4ae0 msgr2=0x7fc58406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:36.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 shutdown_connections 2024-04-25T13:47:36.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.701+0000 7fc58ac81640 1 -- 172.21.15.77:0/2565976827 wait complete. 2024-04-25T13:47:36.722 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:47:36.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd167cf3640 1 Processor -- start 2024-04-25T13:47:36.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd167cf3640 1 -- start start 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd167cf3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1600ac6b0 0x7fd1600ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd167cf3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1600c6960 con 0x7fd1600c7180 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd167cf3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd160153080 con 0x7fd160151990 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd167cf3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd160153340 con 0x7fd1600ac6b0 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd166290640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd1600c7180 0x7fd1600c7590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45948/0 (socket says 172.21.15.77:45948) 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd166290640 1 -- 172.21.15.77:0/1889428142 learned_addr learned my addr 172.21.15.77:0/1889428142 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd165a8f640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1600ac6b0 0x7fd1600ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3366763581 0 0) 0x7fd1600c6960 con 0x7fd1600c7180 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd148003530 con 0x7fd1600c7180 2024-04-25T13:47:36.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3068694829 0 0) 0x7fd148003530 con 0x7fd1600c7180 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1600ac6b0 msgr2=0x7fd1600ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1600ac6b0 0x7fd1600ab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 >> v1:172.21.15.96:6789/0 conn(0x7fd160151990 legacy=0x7fd160151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1600c7ca0 con 0x7fd1600c7180 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7fd150001680 con 0x7fd1600c7180 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 >> v1:172.21.15.77:6789/0 conn(0x7fd1600c7180 legacy=0x7fd1600c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1600ac6b0 0x7fd1480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd148003f70 0x7fd148004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d50 0x7fd148005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd160153340 con 0x7fd148004d50 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd14800bc90 con 0x7fd148003f70 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.869+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd14800be90 con 0x7fd1600ac6b0 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd166290640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d50 0x7fd148005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd165a8f640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1600ac6b0 0x7fd1480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd16528e640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd148003f70 0x7fd148004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd166290640 1 -- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1600ac6b0 msgr2=0x7fd1480039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:36.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd166290640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1600ac6b0 0x7fd1480039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd166290640 1 -- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd148003f70 msgr2=0x7fd148004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:36.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd166290640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd148003f70 0x7fd148004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd166290640 1 -- 172.21.15.77:0/1889428142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd148003530 con 0x7fd148004d50 2024-04-25T13:47:36.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd166290640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d50 0x7fd148005200 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd1600c5450 tx=0x7fd15001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cef89ef70efc0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:36.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150007d40 con 0x7fd148004d50 2024-04-25T13:47:36.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd1500a9070 con 0x7fd148004d50 2024-04-25T13:47:36.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd164a8d640 1 -- 172.21.15.77:0/1889428142 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150005da0 con 0x7fd148004d50 2024-04-25T13:47:36.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd167cf3640 1 -- 172.21.15.77:0/1889428142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d50 msgr2=0x7fd148005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd167cf3640 1 --2- 172.21.15.77:0/1889428142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d50 0x7fd148005200 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd1600c5450 tx=0x7fd15001cc60 comp rx=0 tx=0).stop 2024-04-25T13:47:36.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd166290640 1 -- 172.21.15.77:0/1889428142 reap_dead start 2024-04-25T13:47:36.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd167cf3640 1 -- 172.21.15.77:0/1889428142 shutdown_connections 2024-04-25T13:47:36.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd167cf3640 1 -- 172.21.15.77:0/1889428142 >> 172.21.15.77:0/1889428142 conn(0x7fd16006daf0 msgr2=0x7fd16006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:36.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd167cf3640 1 -- 172.21.15.77:0/1889428142 shutdown_connections 2024-04-25T13:47:36.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.873+0000 7fd167cf3640 1 -- 172.21.15.77:0/1889428142 wait complete. 2024-04-25T13:47:36.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 Processor -- start 2024-04-25T13:47:36.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 -- start start 2024-04-25T13:47:36.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd16015c6f0 0x7fd1600bc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd16014cd80 0x7fd16014bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16014c830 0x7fd16014c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd16015e930 con 0x7fd16014cd80 2024-04-25T13:47:36.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd16015e7b0 con 0x7fd16014c830 2024-04-25T13:47:36.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fd16015eab0 con 0x7fd16015c6f0 2024-04-25T13:47:36.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd16528e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd16014cd80 0x7fd16014bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd16528e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd16014cd80 0x7fd16014bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51348/0 (socket says 172.21.15.77:51348) 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd16528e640 1 -- 172.21.15.77:0/1478788275 learned_addr learned my addr 172.21.15.77:0/1478788275 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd165a8f640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd16015c6f0 0x7fd1600bc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd166290640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16014c830 0x7fd16014c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd16528e640 1 -- 172.21.15.77:0/1478788275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd16015c6f0 msgr2=0x7fd1600bc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd16528e640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd16015c6f0 0x7fd1600bc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd16528e640 1 -- 172.21.15.77:0/1478788275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16014c830 msgr2=0x7fd16014c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd16528e640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16014c830 0x7fd16014c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd16528e640 1 -- 172.21.15.77:0/1478788275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1600bdfd0 con 0x7fd16014cd80 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd16528e640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd16014cd80 0x7fd16014bae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00e460 tx=0x7fd15c00e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd1567fc640 1 -- 172.21.15.77:0/1478788275 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0052e0 con 0x7fd16014cd80 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd1567fc640 1 -- 172.21.15.77:0/1478788275 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd15c018070 con 0x7fd16014cd80 2024-04-25T13:47:36.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1600be650 con 0x7fd16014cd80 2024-04-25T13:47:36.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd1567fc640 1 -- 172.21.15.77:0/1478788275 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c003860 con 0x7fd16014cd80 2024-04-25T13:47:36.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.877+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1601eef00 con 0x7fd16014cd80 2024-04-25T13:47:36.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.881+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1600be440 con 0x7fd16014cd80 2024-04-25T13:47:36.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.881+0000 7fd1567fc640 1 -- 172.21.15.77:0/1478788275 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd15c003a00 con 0x7fd16014cd80 2024-04-25T13:47:36.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.881+0000 7fd1567fc640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd14c06f430 0x7fd14c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:36.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.881+0000 7fd1567fc640 1 -- 172.21.15.77:0/1478788275 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fd15c08efd0 con 0x7fd16014cd80 2024-04-25T13:47:36.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.881+0000 7fd165a8f640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd14c06f430 0x7fd14c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:36.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.881+0000 7fd165a8f640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd14c06f430 0x7fd14c071940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd160152ef0 tx=0x7fd15800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:36.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:36.885+0000 7fd1567fc640 1 -- 172.21.15.77:0/1478788275 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd15c05bf80 con 0x7fd16014cd80 2024-04-25T13:47:37.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.073+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd16006a280 con 0x7fd16014cd80 2024-04-25T13:47:37.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd1567fc640 1 -- 172.21.15.77:0/1478788275 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7fd15c005480 con 0x7fd16014cd80 2024-04-25T13:47:37.077 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:37.077 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2393103049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2393103049},{"type":"v1","addr":"172.21.15.77:6835","nonce":2393103049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:41:03.799479+0000","modified":"2024-04-25T13:41:06.824136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6833/1035589958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":1035589958},{"type":"v1","addr":"172.21.15.96:6833","nonce":1035589958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-04-25T13:47:37.078 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-04-25T13:47:37.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd14c06f430 msgr2=0x7fd14c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd14c06f430 0x7fd14c071940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd160152ef0 tx=0x7fd15800b040 comp rx=0 tx=0).stop 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd16014cd80 msgr2=0x7fd16014bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd16014cd80 0x7fd16014bae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00e460 tx=0x7fd15c00e920 comp rx=0 tx=0).stop 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 shutdown_connections 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fd14c06f430 0x7fd14c071940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16014c830 0x7fd16014c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd16014cd80 0x7fd16014bae0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 --2- 172.21.15.77:0/1478788275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd16015c6f0 0x7fd1600bc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 >> 172.21.15.77:0/1478788275 conn(0x7fd16006daf0 msgr2=0x7fd160151da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 shutdown_connections 2024-04-25T13:47:37.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.077+0000 7fd167cf3640 1 -- 172.21.15.77:0/1478788275 wait complete. 2024-04-25T13:47:37.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:47:37.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f842b5d1640 1 Processor -- start 2024-04-25T13:47:37.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f842b5d1640 1 -- start start 2024-04-25T13:47:37.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f842b5d1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84241542c0 0x7f8424150220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f842b5d1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84241546d0 con 0x7f84240746b0 2024-04-25T13:47:37.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f842b5d1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84240706f0 con 0x7f8424153eb0 2024-04-25T13:47:37.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f842b5d1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f8424153990 con 0x7f84241542c0 2024-04-25T13:47:37.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f842936d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f84240746b0 0x7f84240c1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45962/0 (socket says 172.21.15.77:45962) 2024-04-25T13:47:37.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f842936d640 1 -- 172.21.15.77:0/4084364651 learned_addr learned my addr 172.21.15.77:0/4084364651 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:37.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8429b6e640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84241542c0 0x7f8424150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658536871 0 0) 0x7f84241546d0 con 0x7f84240746b0 2024-04-25T13:47:37.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f840c003530 con 0x7f84240746b0 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2747336120 0 0) 0x7f840c003530 con 0x7f84240746b0 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84241542c0 msgr2=0x7f8424150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84241542c0 0x7f8424150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 >> v1:172.21.15.96:6789/0 conn(0x7f8424153eb0 legacy=0x7f842414fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84240c1b60 con 0x7f84240746b0 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f8414001a00 con 0x7f84240746b0 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 >> v1:172.21.15.77:6789/0 conn(0x7f84240746b0 legacy=0x7f84240c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84241542c0 0x7f840c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c003f70 0x7f840c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c004d50 0x7f840c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8424153990 con 0x7f840c003f70 2024-04-25T13:47:37.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f840c00bc90 con 0x7f840c004d50 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.237+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f840c00be90 con 0x7f84241542c0 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8428b6c640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c003f70 0x7f840c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f842936d640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84241542c0 0x7f840c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8429b6e640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c004d50 0x7f840c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8428b6c640 1 -- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84241542c0 msgr2=0x7f840c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8428b6c640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84241542c0 0x7f840c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8428b6c640 1 -- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c004d50 msgr2=0x7f840c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8428b6c640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c004d50 0x7f840c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8428b6c640 1 -- 172.21.15.77:0/4084364651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840c003530 con 0x7f840c003f70 2024-04-25T13:47:37.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8429b6e640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c004d50 0x7f840c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8428b6c640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c003f70 0x7f840c004810 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f84240729c0 tx=0x7f841801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1a5409a2a13ea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180013a0 con 0x7f840c003f70 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f84180050d0 con 0x7f840c003f70 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8423fff640 1 -- 172.21.15.77:0/4084364651 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418003600 con 0x7f840c003f70 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f842b5d1640 1 -- 172.21.15.77:0/4084364651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c003f70 msgr2=0x7f840c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f842b5d1640 1 --2- 172.21.15.77:0/4084364651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f840c003f70 0x7f840c004810 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f84240729c0 tx=0x7f841801c3c0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f8429b6e640 1 -- 172.21.15.77:0/4084364651 reap_dead start 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f842b5d1640 1 -- 172.21.15.77:0/4084364651 shutdown_connections 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f842b5d1640 1 -- 172.21.15.77:0/4084364651 >> 172.21.15.77:0/4084364651 conn(0x7f84240a6900 msgr2=0x7f84240a6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f842b5d1640 1 -- 172.21.15.77:0/4084364651 shutdown_connections 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.241+0000 7f842b5d1640 1 -- 172.21.15.77:0/4084364651 wait complete. 2024-04-25T13:47:37.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 Processor -- start 2024-04-25T13:47:37.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 -- start start 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c003f70 0x7f84240bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84240bb7f0 0x7f8424157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424158100 0x7f8424155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f842415a6c0 con 0x7f8424158100 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f842415a540 con 0x7f840c003f70 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f842415a840 con 0x7f84240bb7f0 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8429b6e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424158100 0x7f8424155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8429b6e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424158100 0x7f8424155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51366/0 (socket says 172.21.15.77:51366) 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8429b6e640 1 -- 172.21.15.77:0/77345634 learned_addr learned my addr 172.21.15.77:0/77345634 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842936d640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c003f70 0x7f84240bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8428b6c640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84240bb7f0 0x7f8424157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8429b6e640 1 -- 172.21.15.77:0/77345634 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84240bb7f0 msgr2=0x7f8424157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8429b6e640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84240bb7f0 0x7f8424157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8429b6e640 1 -- 172.21.15.77:0/77345634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c003f70 msgr2=0x7f84240bb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8429b6e640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c003f70 0x7f84240bb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8429b6e640 1 -- 172.21.15.77:0/77345634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8424159400 con 0x7f8424158100 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8429b6e640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424158100 0x7f8424155930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8424074660 tx=0x7f841c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8421ffb640 1 -- 172.21.15.77:0/77345634 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00f040 con 0x7f8424158100 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8421ffb640 1 -- 172.21.15.77:0/77345634 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f841c01c070 con 0x7f8424158100 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84241588e0 con 0x7f8424158100 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f8421ffb640 1 -- 172.21.15.77:0/77345634 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00eae0 con 0x7f8424158100 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8424159700 con 0x7f8424158100 2024-04-25T13:47:37.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.245+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842406a280 con 0x7f8424158100 2024-04-25T13:47:37.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.249+0000 7f8421ffb640 1 -- 172.21.15.77:0/77345634 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f841c00ec80 con 0x7f8424158100 2024-04-25T13:47:37.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.249+0000 7f8421ffb640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f841006f400 0x7f8410071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.249+0000 7f8421ffb640 1 -- 172.21.15.77:0/77345634 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f841c08f0f0 con 0x7f8424158100 2024-04-25T13:47:37.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.249+0000 7f842936d640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f841006f400 0x7f8410071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.249+0000 7f842936d640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f841006f400 0x7f8410071910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8414005d20 tx=0x7f8414009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:37.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.253+0000 7f8421ffb640 1 -- 172.21.15.77:0/77345634 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f841c026020 con 0x7f8424158100 2024-04-25T13:47:37.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.405+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84240c3990 con 0x7f8424158100 2024-04-25T13:47:37.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f8421ffb640 1 -- 172.21.15.77:0/77345634 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16853 (secure 0 0 0) 0x7f841c05bf50 con 0x7f8424158100 2024-04-25T13:47:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T13:47:37.410 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"137a8595-336b-48a1-94de-86eaa6851f1a","created":"2024-04-25T13:40:45.594794+0000","modified":"2024-04-25T13:41:51.564949+0000","last_up_change":"2024-04-25T13:40:56.618717+0000","last_in_change":"2024-04-25T13:40:48.459589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:40:58.420007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:41:01.460651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:41:02.746892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca35cc1b-925b-4c72-9e4d-aa5cc30de0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6825","nonce":1056805701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6827","nonce":1056805701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6831","nonce":1056805701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1056805701},{"type":"v1","addr":"172.21.15.77:6829","nonce":1056805701}]},"public_addr":"172.21.15.77:6825/1056805701","cluster_addr":"172.21.15.77:6827/1056805701","heartbeat_back_addr":"172.21.15.77:6831/1056805701","heartbeat_front_addr":"172.21.15.77:6829/1056805701","state":["exists","up"]},{"osd":1,"uuid":"36251241-cee4-477d-b5bd-9c4946cc3a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6811","nonce":2369138658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6815","nonce":2369138658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6823","nonce":2369138658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":2369138658},{"type":"v1","addr":"172.21.15.77:6819","nonce":2369138658}]},"public_addr":"172.21.15.77:6811/2369138658","cluster_addr":"172.21.15.77:6815/2369138658","heartbeat_back_addr":"172.21.15.77:6823/2369138658","heartbeat_front_addr":"172.21.15.77:6819/2369138658","state":["exists","up"]},{"osd":2,"uuid":"f4e329c3-1d35-4b5f-be15-48d2795092ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6801","nonce":4192345588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6803","nonce":4192345588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6807","nonce":4192345588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4192345588},{"type":"v1","addr":"172.21.15.77:6805","nonce":4192345588}]},"public_addr":"172.21.15.77:6801/4192345588","cluster_addr":"172.21.15.77:6803/4192345588","heartbeat_back_addr":"172.21.15.77:6807/4192345588","heartbeat_front_addr":"172.21.15.77:6805/4192345588","state":["exists","up"]},{"osd":3,"uuid":"50871651-83fd-4cce-b440-7e8407f3deb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6810","nonce":3215381613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6814","nonce":3215381613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6821","nonce":3215381613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3215381613},{"type":"v1","addr":"172.21.15.77:6818","nonce":3215381613}]},"public_addr":"172.21.15.77:6810/3215381613","cluster_addr":"172.21.15.77:6814/3215381613","heartbeat_back_addr":"172.21.15.77:6821/3215381613","heartbeat_front_addr":"172.21.15.77:6818/3215381613","state":["exists","up"]},{"osd":4,"uuid":"a87d1437-b6ee-4215-ae40-4710282e5947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6825","nonce":779501835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6827","nonce":779501835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6831","nonce":779501835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":779501835},{"type":"v1","addr":"172.21.15.96:6829","nonce":779501835}]},"public_addr":"172.21.15.96:6825/779501835","cluster_addr":"172.21.15.96:6827/779501835","heartbeat_back_addr":"172.21.15.96:6831/779501835","heartbeat_front_addr":"172.21.15.96:6829/779501835","state":["exists","up"]},{"osd":5,"uuid":"e65b4988-038d-468b-92a3-243a327be1fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6801","nonce":3584918430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6803","nonce":3584918430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6807","nonce":3584918430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3584918430},{"type":"v1","addr":"172.21.15.96:6805","nonce":3584918430}]},"public_addr":"172.21.15.96:6801/3584918430","cluster_addr":"172.21.15.96:6803/3584918430","heartbeat_back_addr":"172.21.15.96:6807/3584918430","heartbeat_front_addr":"172.21.15.96:6805/3584918430","state":["exists","up"]},{"osd":6,"uuid":"d709e3a4-7c69-4eeb-ae98-86539706c15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6809","nonce":4031837167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6813","nonce":4031837167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6820","nonce":4031837167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":4031837167},{"type":"v1","addr":"172.21.15.96:6816","nonce":4031837167}]},"public_addr":"172.21.15.96:6809/4031837167","cluster_addr":"172.21.15.96:6813/4031837167","heartbeat_back_addr":"172.21.15.96:6820/4031837167","heartbeat_front_addr":"172.21.15.96:6816/4031837167","state":["exists","up"]},{"osd":7,"uuid":"959e7f84-6fc5-496f-bcc2-2085b6070a7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6812","nonce":1677667216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6817","nonce":1677667216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6823","nonce":1677667216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":1677667216},{"type":"v1","addr":"172.21.15.96:6821","nonce":1677667216}]},"public_addr":"172.21.15.96:6812/1677667216","cluster_addr":"172.21.15.96:6817/1677667216","heartbeat_back_addr":"172.21.15.96:6823/1677667216","heartbeat_front_addr":"172.21.15.96:6821/1677667216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.095085+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.040685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.891697+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.074052+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.105734+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.867907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:54.017623+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:53.932095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:47:37.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f841006f400 msgr2=0x7f8410071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f841006f400 0x7f8410071910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8414005d20 tx=0x7f8414009040 comp rx=0 tx=0).stop 2024-04-25T13:47:37.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424158100 msgr2=0x7f8424155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424158100 0x7f8424155930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8424074660 tx=0x7f841c010c20 comp rx=0 tx=0).stop 2024-04-25T13:47:37.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 shutdown_connections 2024-04-25T13:47:37.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f841006f400 0x7f8410071910 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8424158100 0x7f8424155930 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84240bb7f0 0x7f8424157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 --2- 172.21.15.77:0/77345634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f840c003f70 0x7f84240bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 >> 172.21.15.77:0/77345634 conn(0x7f84240a6900 msgr2=0x7f842415d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:37.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 shutdown_connections 2024-04-25T13:47:37.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.409+0000 7f842b5d1640 1 -- 172.21.15.77:0/77345634 wait complete. 2024-04-25T13:47:37.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T13:47:37.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe05ba61640 1 Processor -- start 2024-04-25T13:47:37.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe05ba61640 1 -- start start 2024-04-25T13:47:37.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe05ba61640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0540c5770 0x7fe054153420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe05ba61640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe0540ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe05ba61640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe054152940 con 0x7fe05406da90 2024-04-25T13:47:37.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe05ba61640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe054152c20 con 0x7fe0540c5770 2024-04-25T13:47:37.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe05ba61640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe054152f00 con 0x7fe05406dea0 2024-04-25T13:47:37.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe059ffe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe0540ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe0597fd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0540c5770 0x7fe054153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe059ffe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe0540ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.77:50842/0 (socket says 172.21.15.77:50842) 2024-04-25T13:47:37.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe059ffe640 1 -- 172.21.15.77:0/244195383 learned_addr learned my addr 172.21.15.77:0/244195383 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:37.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe0597fd640 1 -- 172.21.15.77:0/244195383 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 msgr2=0x7fe0540ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:37.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe0597fd640 1 --2- 172.21.15.77:0/244195383 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe0540ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe0597fd640 1 -- 172.21.15.77:0/244195383 >> v1:172.21.15.96:6789/0 conn(0x7fe05406da90 legacy=0x7fe0540acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe0597fd640 1 -- 172.21.15.77:0/244195383 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0541525f0 con 0x7fe0540c5770 2024-04-25T13:47:37.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.577+0000 7fe059ffe640 1 --2- 172.21.15.77:0/244195383 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe0540ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:47:37.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe0597fd640 1 --2- 172.21.15.77:0/244195383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0540c5770 0x7fe054153420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0500097c0 tx=0x7fe05001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ad41d0d0c2fd2fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:37.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe047fff640 1 -- 172.21.15.77:0/244195383 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0500b1070 con 0x7fe0540c5770 2024-04-25T13:47:37.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe047fff640 1 -- 172.21.15.77:0/244195383 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe0500ac410 con 0x7fe0540c5770 2024-04-25T13:47:37.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe047fff640 1 -- 172.21.15.77:0/244195383 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0500ac800 con 0x7fe0540c5770 2024-04-25T13:47:37.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe05ba61640 1 -- 172.21.15.77:0/244195383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0540c5770 msgr2=0x7fe054153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe05ba61640 1 --2- 172.21.15.77:0/244195383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0540c5770 0x7fe054153420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0500097c0 tx=0x7fe05001c4a0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe05ba61640 1 -- 172.21.15.77:0/244195383 shutdown_connections 2024-04-25T13:47:37.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe05ba61640 1 --2- 172.21.15.77:0/244195383 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe0540ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe05ba61640 1 --2- 172.21.15.77:0/244195383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0540c5770 0x7fe054153420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe05ba61640 1 -- 172.21.15.77:0/244195383 >> 172.21.15.77:0/244195383 conn(0x7fe0540c7a40 msgr2=0x7fe0540c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:37.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe05ba61640 1 -- 172.21.15.77:0/244195383 shutdown_connections 2024-04-25T13:47:37.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.581+0000 7fe05ba61640 1 -- 172.21.15.77:0/244195383 wait complete. 2024-04-25T13:47:37.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 Processor -- start 2024-04-25T13:47:37.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 -- start start 2024-04-25T13:47:37.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05406da90 0x7fe05414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe05415d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0540c5770 0x7fe0541eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0540c2a60 con 0x7fe0540c5770 2024-04-25T13:47:37.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe0540c28e0 con 0x7fe05406da90 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fe0540c2be0 con 0x7fe05406dea0 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe059ffe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0540c5770 0x7fe0541eb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe059ffe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0540c5770 0x7fe0541eb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51372/0 (socket says 172.21.15.77:51372) 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe059ffe640 1 -- 172.21.15.77:0/1061289250 learned_addr learned my addr 172.21.15.77:0/1061289250 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe058ffc640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe05415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe0597fd640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05406da90 0x7fe05414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe059ffe640 1 -- 172.21.15.77:0/1061289250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 msgr2=0x7fe05415d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe059ffe640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe05415d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe059ffe640 1 -- 172.21.15.77:0/1061289250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05406da90 msgr2=0x7fe05414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe059ffe640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05406da90 0x7fe05414e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe059ffe640 1 -- 172.21.15.77:0/1061289250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe054150d10 con 0x7fe0540c5770 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe059ffe640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0540c5770 0x7fe0541eb7f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00efc0 tx=0x7fe04c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe045ffb640 1 -- 172.21.15.77:0/1061289250 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00cbe0 con 0x7fe0540c5770 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe045ffb640 1 -- 172.21.15.77:0/1061289250 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe04c00cd80 con 0x7fe0540c5770 2024-04-25T13:47:37.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe045ffb640 1 -- 172.21.15.77:0/1061289250 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c003c00 con 0x7fe0540c5770 2024-04-25T13:47:37.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05414ff70 con 0x7fe0540c5770 2024-04-25T13:47:37.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.585+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05414e9d0 con 0x7fe0540c5770 2024-04-25T13:47:37.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.589+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe05406a1a0 con 0x7fe0540c5770 2024-04-25T13:47:37.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.589+0000 7fe045ffb640 1 -- 172.21.15.77:0/1061289250 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe04c01b030 con 0x7fe0540c5770 2024-04-25T13:47:37.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.589+0000 7fe045ffb640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe03806f400 0x7fe038071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.589+0000 7fe045ffb640 1 -- 172.21.15.77:0/1061289250 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe04c08f750 con 0x7fe0540c5770 2024-04-25T13:47:37.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.589+0000 7fe0597fd640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe03806f400 0x7fe038071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.589+0000 7fe0597fd640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe03806f400 0x7fe038071910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ae000 tx=0x7fe050008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:37.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.593+0000 7fe045ffb640 1 -- 172.21.15.77:0/1061289250 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe04c022020 con 0x7fe0540c5770 2024-04-25T13:47:37.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.789+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe0541eb130 con 0x7fe0540c5770 2024-04-25T13:47:37.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.793+0000 7fe045ffb640 1 -- 172.21.15.77:0/1061289250 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7fe04c010040 con 0x7fe0540c5770 2024-04-25T13:47:37.794 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T13:47:37.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.793+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe03806f400 msgr2=0x7fe038071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe03806f400 0x7fe038071910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ae000 tx=0x7fe050008040 comp rx=0 tx=0).stop 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0540c5770 msgr2=0x7fe0541eb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0540c5770 0x7fe0541eb7f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00efc0 tx=0x7fe04c00c490 comp rx=0 tx=0).stop 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 shutdown_connections 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fe03806f400 0x7fe038071910 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0540c5770 0x7fe0541eb7f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe05406dea0 0x7fe05415d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 --2- 172.21.15.77:0/1061289250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe05406da90 0x7fe05414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 >> 172.21.15.77:0/1061289250 conn(0x7fe0540c7a40 msgr2=0x7fe0540bdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 shutdown_connections 2024-04-25T13:47:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.797+0000 7fe05ba61640 1 -- 172.21.15.77:0/1061289250 wait complete. 2024-04-25T13:47:37.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T13:47:37.911 INFO:tasks.ceph.mds.b.smithi096.stdout:starting mds.b at 2024-04-25T13:47:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.965+0000 7f8b70796640 1 Processor -- start 2024-04-25T13:47:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.965+0000 7f8b70796640 1 -- start start 2024-04-25T13:47:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b680bf910 0x7f8b6814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8b680c0b70 0x7f8b6814f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b680a4b10 con 0x7f8b6814f760 2024-04-25T13:47:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8b680a50d0 con 0x7f8b680bf910 2024-04-25T13:47:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f8b680a4df0 con 0x7f8b680c0b70 2024-04-25T13:47:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6e532640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b680bf910 0x7f8b6814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6ed33640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8b6814f760 0x7f8b68152260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45974/0 (socket says 172.21.15.77:45974) 2024-04-25T13:47:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6ed33640 1 -- 172.21.15.77:0/1604314825 learned_addr learned my addr 172.21.15.77:0/1604314825 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6dd31640 1 --2- 172.21.15.77:0/1604314825 >> v2:172.21.15.96:3300/0 conn(0x7f8b680c0b70 0x7f8b6814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6e532640 1 -- 172.21.15.77:0/1604314825 >> v2:172.21.15.96:3300/0 conn(0x7f8b680c0b70 msgr2=0x7f8b6814f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6e532640 1 --2- 172.21.15.77:0/1604314825 >> v2:172.21.15.96:3300/0 conn(0x7f8b680c0b70 0x7f8b6814f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6e532640 1 -- 172.21.15.77:0/1604314825 >> v1:172.21.15.77:6789/0 conn(0x7f8b6814f760 legacy=0x7f8b68152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6d530640 1 -- 172.21.15.77:0/1604314825 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209112448 0 0) 0x7f8b680a4b10 con 0x7f8b6814f760 2024-04-25T13:47:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6e532640 1 -- 172.21.15.77:0/1604314825 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b680a2fb0 con 0x7f8b680bf910 2024-04-25T13:47:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6e532640 1 --2- 172.21.15.77:0/1604314825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b680bf910 0x7f8b6814e8a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8b680a6510 tx=0x7f8b6401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a773df54b5a18d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6d530640 1 -- 172.21.15.77:0/1604314825 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b640b0070 con 0x7f8b680bf910 2024-04-25T13:47:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6d530640 1 -- 172.21.15.77:0/1604314825 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8b640ab600 con 0x7f8b680bf910 2024-04-25T13:47:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b6d530640 1 -- 172.21.15.77:0/1604314825 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b640ab9f0 con 0x7f8b680bf910 2024-04-25T13:47:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 -- 172.21.15.77:0/1604314825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b680bf910 msgr2=0x7f8b6814e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 --2- 172.21.15.77:0/1604314825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b680bf910 0x7f8b6814e8a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8b680a6510 tx=0x7f8b6401c480 comp rx=0 tx=0).stop 2024-04-25T13:47:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 -- 172.21.15.77:0/1604314825 shutdown_connections 2024-04-25T13:47:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 --2- 172.21.15.77:0/1604314825 >> v2:172.21.15.96:3300/0 conn(0x7f8b680c0b70 0x7f8b6814f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 --2- 172.21.15.77:0/1604314825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b680bf910 0x7f8b6814e8a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.969+0000 7f8b70796640 1 -- 172.21.15.77:0/1604314825 >> 172.21.15.77:0/1604314825 conn(0x7f8b680c3cd0 msgr2=0x7f8b680c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:37.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 -- 172.21.15.77:0/1604314825 shutdown_connections 2024-04-25T13:47:37.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 -- 172.21.15.77:0/1604314825 wait complete. 2024-04-25T13:47:37.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 Processor -- start 2024-04-25T13:47:37.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 -- start start 2024-04-25T13:47:37.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b680bf910 0x7f8b681eb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b680c0b70 0x7f8b681e8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6814f760 0x7f8b68146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b68159540 con 0x7f8b6814f760 2024-04-25T13:47:37.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8b681593c0 con 0x7f8b680c0b70 2024-04-25T13:47:37.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f8b681596c0 con 0x7f8b680bf910 2024-04-25T13:47:37.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6ed33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6814f760 0x7f8b68146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6ed33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6814f760 0x7f8b68146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51392/0 (socket says 172.21.15.77:51392) 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6ed33640 1 -- 172.21.15.77:0/4202960707 learned_addr learned my addr 172.21.15.77:0/4202960707 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6dd31640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b680c0b70 0x7f8b681e8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6e532640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b680bf910 0x7f8b681eb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6ed33640 1 -- 172.21.15.77:0/4202960707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b680bf910 msgr2=0x7f8b681eb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6ed33640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b680bf910 0x7f8b681eb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6ed33640 1 -- 172.21.15.77:0/4202960707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b680c0b70 msgr2=0x7f8b681e8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6ed33640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b680c0b70 0x7f8b681e8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6ed33640 1 -- 172.21.15.77:0/4202960707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b68155510 con 0x7f8b6814f760 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6dd31640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b680c0b70 0x7f8b681e8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b6ed33640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6814f760 0x7f8b68146c00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000c6a0 tx=0x7f8b6000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b5effd640 1 -- 172.21.15.77:0/4202960707 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60018070 con 0x7f8b6814f760 2024-04-25T13:47:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b5effd640 1 -- 172.21.15.77:0/4202960707 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8b60004d70 con 0x7f8b6814f760 2024-04-25T13:47:37.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b681557b0 con 0x7f8b6814f760 2024-04-25T13:47:37.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b5effd640 1 -- 172.21.15.77:0/4202960707 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000a840 con 0x7f8b6814f760 2024-04-25T13:47:37.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.973+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6814b950 con 0x7f8b6814f760 2024-04-25T13:47:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.977+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6814bbb0 con 0x7f8b6814f760 2024-04-25T13:47:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.977+0000 7f8b5effd640 1 -- 172.21.15.77:0/4202960707 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8b6001b070 con 0x7f8b6814f760 2024-04-25T13:47:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.977+0000 7f8b5effd640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b4c06f400 0x7f8b4c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.977+0000 7f8b6e532640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b4c06f400 0x7f8b4c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.977+0000 7f8b5effd640 1 -- 172.21.15.77:0/4202960707 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f8b6008e960 con 0x7f8b6814f760 2024-04-25T13:47:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.977+0000 7f8b6e532640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b4c06f400 0x7f8b4c071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8b640ad000 tx=0x7f8b640a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:37.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:37.981+0000 7f8b5effd640 1 -- 172.21.15.77:0/4202960707 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b6005b760 con 0x7f8b6814f760 2024-04-25T13:47:38.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.161+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8b6806a1a0 con 0x7f8b6814f760 2024-04-25T13:47:38.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.797+0000 7f8b5effd640 1 -- 172.21.15.77:0/4202960707 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f8b6005b060 con 0x7f8b6814f760 2024-04-25T13:47:38.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b4c06f400 msgr2=0x7f8b4c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:38.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b4c06f400 0x7f8b4c071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8b640ad000 tx=0x7f8b640a6000 comp rx=0 tx=0).stop 2024-04-25T13:47:38.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6814f760 msgr2=0x7f8b68146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:38.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6814f760 0x7f8b68146c00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000c6a0 tx=0x7f8b6000cb60 comp rx=0 tx=0).stop 2024-04-25T13:47:38.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 shutdown_connections 2024-04-25T13:47:38.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f8b4c06f400 0x7f8b4c071910 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:38.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b6814f760 0x7f8b68146c00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:38.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b680c0b70 0x7f8b681e8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:38.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 --2- 172.21.15.77:0/4202960707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8b680bf910 0x7f8b681eb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:38.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 >> 172.21.15.77:0/4202960707 conn(0x7f8b680c3cd0 msgr2=0x7f8b680c1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:38.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 shutdown_connections 2024-04-25T13:47:38.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.801+0000 7f8b70796640 1 -- 172.21.15.77:0/4202960707 wait complete. 2024-04-25T13:47:38.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T13:47:38.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e90bc6640 1 Processor -- start 2024-04-25T13:47:38.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e90bc6640 1 -- start start 2024-04-25T13:47:38.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e90bc6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c0c5f50 0x7f3e8c0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:38.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e90bc6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8c0a50c0 con 0x7f3e8c0c3740 2024-04-25T13:47:38.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e90bc6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8c0749a0 con 0x7f3e8c1559d0 2024-04-25T13:47:38.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e90bc6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8c06d6c0 con 0x7f3e8c0c5f50 2024-04-25T13:47:38.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8a59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3e8c0c3740 0x7f3e8c151cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45982/0 (socket says 172.21.15.77:45982) 2024-04-25T13:47:38.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8a59c640 1 -- 172.21.15.77:0/2461243581 learned_addr learned my addr 172.21.15.77:0/2461243581 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:38.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3719247841 0 0) 0x7f3e8c0a50c0 con 0x7f3e8c0c3740 2024-04-25T13:47:38.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e89d9b640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c0c5f50 0x7f3e8c0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e74003530 con 0x7f3e8c0c3740 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 246940724 0 0) 0x7f3e74003530 con 0x7f3e8c0c3740 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c0c5f50 msgr2=0x7f3e8c0c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8959a640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c0c5f50 0x7f3e8c0c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 >> v1:172.21.15.96:6789/0 conn(0x7f3e8c1559d0 legacy=0x7f3e8c155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c1564f0 con 0x7f3e8c0c3740 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.989+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3583180438 0 0) 0x7f3e7c001680 con 0x7f3e8c0c3740 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 >> v1:172.21.15.77:6789/0 conn(0x7f3e8c0c3740 legacy=0x7f3e8c151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e740039f0 0x7f3e74003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c0c5f50 0x7f3e74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e74005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c06d6c0 con 0x7f3e74004d50 2024-04-25T13:47:38.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7400bc30 con 0x7f3e740039f0 2024-04-25T13:47:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7400be30 con 0x7f3e8c0c5f50 2024-04-25T13:47:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8ad9d640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e74005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e89d9b640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c0c5f50 0x7f3e74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8a59c640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e740039f0 0x7f3e74003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8ad9d640 1 -- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c0c5f50 msgr2=0x7f3e74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8ad9d640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c0c5f50 0x7f3e74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8ad9d640 1 -- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e740039f0 msgr2=0x7f3e74003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8ad9d640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e740039f0 0x7f3e74003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:38.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8ad9d640 1 -- 172.21.15.77:0/2461243581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e74003530 con 0x7f3e74004d50 2024-04-25T13:47:38.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8ad9d640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e74005200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c071fe0 tx=0x7f3e8401c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d5b70b2073e10e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:38.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840b0070 con 0x7f3e74004d50 2024-04-25T13:47:38.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3e84003b80 con 0x7f3e74004d50 2024-04-25T13:47:38.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8959a640 1 -- 172.21.15.77:0/2461243581 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84001a90 con 0x7f3e74004d50 2024-04-25T13:47:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e90bc6640 1 -- 172.21.15.77:0/2461243581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 msgr2=0x7f3e74005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e90bc6640 1 --2- 172.21.15.77:0/2461243581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e74005200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c071fe0 tx=0x7f3e8401c720 comp rx=0 tx=0).stop 2024-04-25T13:47:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e8ad9d640 1 -- 172.21.15.77:0/2461243581 reap_dead start 2024-04-25T13:47:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e90bc6640 1 -- 172.21.15.77:0/2461243581 shutdown_connections 2024-04-25T13:47:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e90bc6640 1 -- 172.21.15.77:0/2461243581 >> 172.21.15.77:0/2461243581 conn(0x7f3e8c0a7ea0 msgr2=0x7f3e8c0c5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.993+0000 7f3e90bc6640 1 -- 172.21.15.77:0/2461243581 shutdown_connections 2024-04-25T13:47:38.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 -- 172.21.15.77:0/2461243581 wait complete. 2024-04-25T13:47:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 Processor -- start 2024-04-25T13:47:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 -- start start 2024-04-25T13:47:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e8c1ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c145eb0 0x7f3e8c148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e8c0a6b00 0x7f3e8c0a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c15e8f0 con 0x7f3e74004d50 2024-04-25T13:47:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c15e770 con 0x7f3e8c0a6b00 2024-04-25T13:47:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8c15ea70 con 0x7f3e8c145eb0 2024-04-25T13:47:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e8c1ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e8c1ef0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51400/0 (socket says 172.21.15.77:51400) 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8a59c640 1 -- 172.21.15.77:0/3200467972 learned_addr learned my addr 172.21.15.77:0/3200467972 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e89d9b640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c145eb0 0x7f3e8c148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8ad9d640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e8c0a6b00 0x7f3e8c0a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8a59c640 1 -- 172.21.15.77:0/3200467972 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c145eb0 msgr2=0x7f3e8c148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8a59c640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c145eb0 0x7f3e8c148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8a59c640 1 -- 172.21.15.77:0/3200467972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e8c0a6b00 msgr2=0x7f3e8c0a6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8a59c640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e8c0a6b00 0x7f3e8c0a6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8a59c640 1 -- 172.21.15.77:0/3200467972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c145a00 con 0x7f3e74004d50 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e89d9b640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c145eb0 0x7f3e8c148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e8a59c640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e8c1ef0c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c004f00 tx=0x7f3e7c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e7affd640 1 -- 172.21.15.77:0/3200467972 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c00f7b0 con 0x7f3e74004d50 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e7affd640 1 -- 172.21.15.77:0/3200467972 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3e7c018070 con 0x7f3e74004d50 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8c1ef600 con 0x7f3e74004d50 2024-04-25T13:47:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e7affd640 1 -- 172.21.15.77:0/3200467972 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c00fbd0 con 0x7f3e74004d50 2024-04-25T13:47:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:38.997+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8c1545a0 con 0x7f3e74004d50 2024-04-25T13:47:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.001+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8c154800 con 0x7f3e74004d50 2024-04-25T13:47:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.001+0000 7f3e7affd640 1 -- 172.21.15.77:0/3200467972 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3e7c01d460 con 0x7f3e74004d50 2024-04-25T13:47:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.001+0000 7f3e7affd640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3e6c06f430 0x7f3e6c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.001+0000 7f3e7affd640 1 -- 172.21.15.77:0/3200467972 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f3e7c08f4b0 con 0x7f3e74004d50 2024-04-25T13:47:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.001+0000 7f3e89d9b640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3e6c06f430 0x7f3e6c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.001+0000 7f3e89d9b640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3e6c06f430 0x7f3e6c071940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c1501e0 tx=0x7f3e80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.005+0000 7f3e7affd640 1 -- 172.21.15.77:0/3200467972 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e7c05c2b0 con 0x7f3e74004d50 2024-04-25T13:47:39.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.169+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3e8c06a2f0 con 0x7f3e74004d50 2024-04-25T13:47:39.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.797+0000 7f3e7affd640 1 -- 172.21.15.77:0/3200467972 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f3e7c05bbb0 con 0x7f3e74004d50 2024-04-25T13:47:39.800 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2024-04-25T13:47:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3e6c06f430 msgr2=0x7f3e6c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3e6c06f430 0x7f3e6c071940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c1501e0 tx=0x7f3e80008040 comp rx=0 tx=0).stop 2024-04-25T13:47:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 msgr2=0x7f3e8c1ef0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:39.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e8c1ef0c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c004f00 tx=0x7f3e7c007430 comp rx=0 tx=0).stop 2024-04-25T13:47:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 shutdown_connections 2024-04-25T13:47:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7f3e6c06f430 0x7f3e6c071940 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e8c0a6b00 0x7f3e8c0a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c145eb0 0x7f3e8c148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 --2- 172.21.15.77:0/3200467972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e74004d50 0x7f3e8c1ef0c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 >> 172.21.15.77:0/3200467972 conn(0x7f3e8c0a7ea0 msgr2=0x7f3e8c070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 shutdown_connections 2024-04-25T13:47:39.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.805+0000 7f3e90bc6640 1 -- 172.21.15.77:0/3200467972 wait complete. 2024-04-25T13:47:39.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T13:47:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda85095640 1 Processor -- start 2024-04-25T13:47:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda85095640 1 -- start start 2024-04-25T13:47:39.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda85095640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda80151cf0 0x7fda801558f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda85095640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fda80155e30 0x7fda800709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda85095640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda800a9ba0 con 0x7fda80074610 2024-04-25T13:47:39.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda85095640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fda80074a20 con 0x7fda80155e30 2024-04-25T13:47:39.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda85095640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fda80152800 con 0x7fda80151cf0 2024-04-25T13:47:39.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda7f59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fda80155e30 0x7fda800709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda7ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fda80074610 0x7fda80152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45984/0 (socket says 172.21.15.77:45984) 2024-04-25T13:47:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.977+0000 7fda7ed9d640 1 -- 172.21.15.77:0/1568438427 learned_addr learned my addr 172.21.15.77:0/1568438427 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T13:47:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7e59c640 1 --2- 172.21.15.77:0/1568438427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda80151cf0 0x7fda801558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7f59e640 1 -- 172.21.15.77:0/1568438427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda80151cf0 msgr2=0x7fda801558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:47:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7f59e640 1 --2- 172.21.15.77:0/1568438427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda80151cf0 0x7fda801558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7f59e640 1 -- 172.21.15.77:0/1568438427 >> v1:172.21.15.77:6789/0 conn(0x7fda80074610 legacy=0x7fda80152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7dd9b640 1 -- 172.21.15.77:0/1568438427 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148501612 0 0) 0x7fda800a9ba0 con 0x7fda80074610 2024-04-25T13:47:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7f59e640 1 -- 172.21.15.77:0/1568438427 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda80074c60 con 0x7fda80155e30 2024-04-25T13:47:39.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7f59e640 1 --2- 172.21.15.77:0/1568438427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80155e30 0x7fda800709b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fda78009d90 tx=0x7fda7801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2cc9e17c44b35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:39.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7dd9b640 1 -- 172.21.15.77:0/1568438427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda780b2070 con 0x7fda80155e30 2024-04-25T13:47:39.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7dd9b640 1 -- 172.21.15.77:0/1568438427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fda780a58b0 con 0x7fda80155e30 2024-04-25T13:47:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda7dd9b640 1 -- 172.21.15.77:0/1568438427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda780a5ca0 con 0x7fda80155e30 2024-04-25T13:47:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda85095640 1 -- 172.21.15.77:0/1568438427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80155e30 msgr2=0x7fda800709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda85095640 1 --2- 172.21.15.77:0/1568438427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80155e30 0x7fda800709b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fda78009d90 tx=0x7fda7801c8e0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda85095640 1 -- 172.21.15.77:0/1568438427 shutdown_connections 2024-04-25T13:47:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda85095640 1 --2- 172.21.15.77:0/1568438427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80155e30 0x7fda800709b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda85095640 1 --2- 172.21.15.77:0/1568438427 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda80151cf0 0x7fda801558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda85095640 1 -- 172.21.15.77:0/1568438427 >> 172.21.15.77:0/1568438427 conn(0x7fda800c4be0 msgr2=0x7fda800c10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda85095640 1 -- 172.21.15.77:0/1568438427 shutdown_connections 2024-04-25T13:47:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.981+0000 7fda85095640 1 -- 172.21.15.77:0/1568438427 wait complete. 2024-04-25T13:47:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 Processor -- start 2024-04-25T13:47:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 -- start start 2024-04-25T13:47:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda80074610 0x7fda800be420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80151cf0 0x7fda8014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda80155e30 0x7fda800c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda8015f830 con 0x7fda80151cf0 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fda8015f6b0 con 0x7fda80155e30 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 -- 0x7fda8015f9b0 con 0x7fda80074610 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda7e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80151cf0 0x7fda8014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda7e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80151cf0 0x7fda8014e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51416/0 (socket says 172.21.15.77:51416) 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda7e59c640 1 -- 172.21.15.77:0/3575018168 learned_addr learned my addr 172.21.15.77:0/3575018168 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda7e59c640 1 -- 172.21.15.77:0/3575018168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda80074610 msgr2=0x7fda800be420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda7e59c640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda80074610 0x7fda800be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda7e59c640 1 -- 172.21.15.77:0/3575018168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda80155e30 msgr2=0x7fda800c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda7e59c640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda80155e30 0x7fda800c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda7e59c640 1 -- 172.21.15.77:0/3575018168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8014eb60 con 0x7fda80151cf0 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda7e59c640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80151cf0 0x7fda8014e620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fda7400d5f0 tx=0x7fda7400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda677fe640 1 -- 172.21.15.77:0/3575018168 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda740125f0 con 0x7fda80151cf0 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda677fe640 1 -- 172.21.15.77:0/3575018168 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fda74019070 con 0x7fda80151cf0 2024-04-25T13:47:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda677fe640 1 -- 172.21.15.77:0/3575018168 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda740129d0 con 0x7fda80151cf0 2024-04-25T13:47:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda80148920 con 0x7fda80151cf0 2024-04-25T13:47:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.985+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda800bf220 con 0x7fda80151cf0 2024-04-25T13:47:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.989+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda8006a2f0 con 0x7fda80151cf0 2024-04-25T13:47:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.989+0000 7fda677fe640 1 -- 172.21.15.77:0/3575018168 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fda74012b70 con 0x7fda80151cf0 2024-04-25T13:47:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.989+0000 7fda677fe640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fda6c06f400 0x7fda6c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:47:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.989+0000 7fda677fe640 1 -- 172.21.15.77:0/3575018168 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5502+0+0 (secure 0 0 0) 0x7fda7408f600 con 0x7fda80151cf0 2024-04-25T13:47:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.989+0000 7fda7ed9d640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fda6c06f400 0x7fda6c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:47:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.989+0000 7fda7ed9d640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fda6c06f400 0x7fda6c071910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fda700015a0 tx=0x7fda70007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:47:39.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:39.993+0000 7fda677fe640 1 -- 172.21.15.77:0/3575018168 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fda7405c5c0 con 0x7fda80151cf0 2024-04-25T13:47:40.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.153+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fda8015ca60 con 0x7fda80151cf0 2024-04-25T13:47:40.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.809+0000 7fda677fe640 1 -- 172.21.15.77:0/3575018168 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7fda7405bec0 con 0x7fda80151cf0 2024-04-25T13:47:40.810 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2024-04-25T13:47:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.817+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fda6c06f400 msgr2=0x7fda6c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:40.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.817+0000 7fda85095640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fda6c06f400 0x7fda6c071910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fda700015a0 tx=0x7fda70007970 comp rx=0 tx=0).stop 2024-04-25T13:47:40.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.817+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80151cf0 msgr2=0x7fda8014e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:47:40.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.817+0000 7fda85095640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80151cf0 0x7fda8014e620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fda7400d5f0 tx=0x7fda7400dab0 comp rx=0 tx=0).stop 2024-04-25T13:47:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.821+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 shutdown_connections 2024-04-25T13:47:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.821+0000 7fda85095640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:6832/4289912412,v1:172.21.15.77:6833/4289912412] conn(0x7fda6c06f400 0x7fda6c071910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.821+0000 7fda85095640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda80155e30 0x7fda800c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.821+0000 7fda85095640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda80151cf0 0x7fda8014e620 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.821+0000 7fda85095640 1 --2- 172.21.15.77:0/3575018168 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda80074610 0x7fda800be420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:47:40.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.821+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 >> 172.21.15.77:0/3575018168 conn(0x7fda800c4be0 msgr2=0x7fda800a6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:47:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.821+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 shutdown_connections 2024-04-25T13:47:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T13:47:40.821+0000 7fda85095640 1 -- 172.21.15.77:0/3575018168 wait complete. 2024-04-25T13:47:40.855 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T13:47:40.856 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T13:47:40.856 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:40.876 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T13:47:40.876 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T13:47:40.876 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:40.905 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T13:47:40.906 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T13:47:40.906 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T13:47:40.906 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:41.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:41.517 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:41.520 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:41.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:41.525 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:47.007 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T13:47:47.007 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T13:47:47.007 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.083 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T13:47:47.083 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T13:47:47.083 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.165 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T13:47:47.165 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T13:47:47.165 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-25T13:47:47.258 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T13:47:47.258 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T13:47:47.258 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.339 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T13:47:47.339 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T13:47:47.339 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.409 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T13:47:47.409 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T13:47:47.409 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.483 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T13:47:47.484 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T13:47:47.484 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.557 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T13:47:47.557 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T13:47:47.557 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T13:47:47.557 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.589 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T13:47:47.590 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T13:47:47.590 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.618 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T13:47:47.618 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T13:47:47.618 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T13:47:47.618 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.658 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T13:47:47.658 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T13:47:47.658 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.682 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T13:47:47.682 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T13:47:47.682 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:47:47.742 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T13:47:47.742 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T13:47:47.743 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T13:47:47.760 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:47:47.760 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T13:47:48.330 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:47:48.330 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T13:47:48.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:47:48.548 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T13:47:48.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:47:48.720 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T13:47:48.894 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:47:48.895 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T13:47:49.351 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:47:49.352 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T13:47:49.599 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:47:49.599 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T13:47:49.779 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:47:49.780 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T13:47:49.985 INFO:tasks.ceph:Archiving mon data... 2024-04-25T13:47:49.987 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/data/mon.a.tgz 2024-04-25T13:47:49.987 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-04-25T13:47:49.993 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.A4h30ipuMU 2024-04-25T13:47:49.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.A4h30ipuMU 2024-04-25T13:47:50.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.A4h30ipuMU 2024-04-25T13:47:50.182 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.A4h30ipuMU is 320KB 2024-04-25T13:47:50.242 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.A4h30ipuMU 2024-04-25T13:47:50.248 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/data/mon.b.tgz 2024-04-25T13:47:50.248 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-25T13:47:50.254 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.uzYIkrc69J 2024-04-25T13:47:50.254 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.uzYIkrc69J 2024-04-25T13:47:50.405 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.uzYIkrc69J 2024-04-25T13:47:50.467 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.uzYIkrc69J is 428KB 2024-04-25T13:47:50.531 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.uzYIkrc69J 2024-04-25T13:47:50.536 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/data/mon.c.tgz 2024-04-25T13:47:50.536 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-25T13:47:50.583 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.8nayIfy7RE 2024-04-25T13:47:50.583 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8nayIfy7RE 2024-04-25T13:47:50.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.8nayIfy7RE 2024-04-25T13:47:50.795 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.8nayIfy7RE is 428KB 2024-04-25T13:47:50.813 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.8nayIfy7RE 2024-04-25T13:47:50.819 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T13:47:50.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:47:50.822 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:47:50.864 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:47:50.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:47:50.869 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:47:50.889 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:47:50.923 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:47:50.928 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:47:50.934 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:47:50.939 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:47:50.939 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T13:47:50.941 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi077/crash 2024-04-25T13:47:50.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:47:50.955 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi096/crash 2024-04-25T13:47:50.956 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:47:50.978 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi097/crash 2024-04-25T13:47:50.979 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:47:50.992 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi151/crash 2024-04-25T13:47:50.993 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:47:51.008 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi191/crash 2024-04-25T13:47:51.009 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:47:51.022 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T13:47:51.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.025 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.027 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.053 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.369 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.383 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.409 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:47:51.422 INFO:tasks.ceph:Compressing logs... 2024-04-25T13:47:51.422 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:47:51.424 DEBUG:teuthology.orchestra.run.smithi096:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:47:51.428 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:47:51.439 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:47:51.440 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-04-25T13:47:51.440 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T13:47:51.441 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32432.log 2024-04-25T13:47:51.441 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-04-25T13:47:51.441 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31754.log 2024-04-25T13:47:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33441.log 2024-04-25T13:47:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32432.log: /var/log/ceph/ceph-client.admin.31754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32718.log 2024-04-25T13:47:51.443 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32432.log.gz 2024-04-25T13:47:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33441.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31754.log.gz 2024-04-25T13:47:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32191.log 2024-04-25T13:47:51.443 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33441.log.gz 2024-04-25T13:47:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32199.log 2024-04-25T13:47:51.445 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32718.log: /var/log/ceph/ceph-client.admin.32191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33831.log 2024-04-25T13:47:51.445 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32191.log.gz 2024-04-25T13:47:51.445 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32199.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32718.log.gz 2024-04-25T13:47:51.445 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T13:47:51.445 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32199.log.gz 2024-04-25T13:47:51.445 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.33831.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34223.log 2024-04-25T13:47:51.446 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32406.log 2024-04-25T13:47:51.446 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33831.log.gz 2024-04-25T13:47:51.446 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31990.log 2024-04-25T13:47:51.446 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34223.log.gz 2024-04-25T13:47:51.446 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34249.log 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32406.log.gz 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32458.log 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31990.log: /var/log/ceph/ceph-client.admin.34249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32200.log 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31990.log.gz 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34249.log.gz 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33727.log 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32458.log.gz 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32200.log: /var/log/ceph/ceph-client.admin.33989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32640.log 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32200.log.gz 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33805.log 2024-04-25T13:47:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.33727.log.gz 2024-04-25T13:47:51.451 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.34171.log 2024-04-25T13:47:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32640.log: /var/log/ceph/ceph-client.admin.33805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34197.log 2024-04-25T13:47:51.451 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32640.log.gz 2024-04-25T13:47:51.451 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33805.log.gz 2024-04-25T13:47:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34171.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T13:47:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27661.log 2024-04-25T13:47:51.451 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34171.log.gz 2024-04-25T13:47:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34197.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33545.log 2024-04-25T13:47:51.451 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34197.log.gz 2024-04-25T13:47:51.456 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.27661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31989.log 2024-04-25T13:47:51.456 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27661.log.gz 2024-04-25T13:47:51.456 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-04-25T13:47:51.456 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33545.log: /var/log/ceph/ceph-client.admin.31989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32944.log 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33545.log.gz 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34429.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31989.log.gz 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32872.log 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34455.log 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32944.log.gz 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31676.log 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34455.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32872.log.gz 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31884.log 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33675.log 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34455.log.gz 2024-04-25T13:47:51.457 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31676.log: /var/log/ceph/ceph-client.admin.31884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32614.log 2024-04-25T13:47:51.458 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1%/var/log/ceph/ceph-client.admin.33675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32179.log 2024-04-25T13:47:51.458 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31676.log.gz 2024-04-25T13:47:51.458 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31884.log.gz 2024-04-25T13:47:51.458 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31981.log 2024-04-25T13:47:51.458 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33675.log.gz 2024-04-25T13:47:51.458 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32614.log.gz 2024-04-25T13:47:51.458 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33389.log 2024-04-25T13:47:51.458 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32179.log.gz 2024-04-25T13:47:51.458 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34119.log 2024-04-25T13:47:51.460 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:47:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22906.log 2024-04-25T13:47:51.473 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.22883.log 2024-04-25T13:47:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T13:47:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T13:47:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27702.log 2024-04-25T13:47:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27829.log 2024-04-25T13:47:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.27702.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T13:47:51.475 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27702.log.gz 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27654.log 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27829.log.gz 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.27654.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27654.log.gz 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mgr.x.log: gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27726.log 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27750.log 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27726.log: /var/log/ceph/ceph-client.admin.27750.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27726.log.gz 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27750.log.gz 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27774.log 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr: 92.3%/var/log/ceph/ceph.audit.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:47:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27774.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T13:47:51.477 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27774.log.gz 2024-04-25T13:47:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T13:47:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-mon.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:47:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27798.log 2024-04-25T13:47:51.477 INFO:teuthology.orchestra.run.smithi096.stderr: 93.9%/var/log/ceph/ceph-osd.4.log: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T13:47:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27678.log 2024-04-25T13:47:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27798.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27798.log.gz 2024-04-25T13:47:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.27678.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27678.log.gz 2024-04-25T13:47:51.487 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33389.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31981.log.gz 2024-04-25T13:47:51.487 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34015.log 2024-04-25T13:47:51.487 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33389.log.gz 2024-04-25T13:47:51.487 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32510.log 2024-04-25T13:47:51.487 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34119.log.gz 2024-04-25T13:47:51.487 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34041.log 2024-04-25T13:47:51.487 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32510.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34015.log.gz 2024-04-25T13:47:51.487 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34377.log 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3%/var/log/ceph/ceph-client.admin.34041.log: -- replaced with /var/log/ceph/ceph-client.admin.32510.log.gz 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32770.log 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8%/var/log/ceph/ceph-client.admin.34377.log: -- replaced with /var/log/ceph/ceph-client.admin.34041.log.gz 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31780.log 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34377.log.gz 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34275.log 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33857.log 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34275.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31780.log.gz 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31622.log 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32770.log.gz 2024-04-25T13:47:51.488 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34275.log.gz 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32846.log 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33857.log: /var/log/ceph/ceph-client.admin.31622.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3%/var/log/ceph/ceph-client.admin.32846.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31622.log.gz 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33074.log 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33857.log.gz 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.3.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32666.log 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32846.log.gz 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33337.log 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32666.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33074.log.gz 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32666.log.gz 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33337.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33337.log.gz 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32562.log 2024-04-25T13:47:51.489 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31728.log 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31527.log 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8%/var/log/ceph/ceph-client.admin.31728.log: -- replaced with /var/log/ceph/ceph-client.admin.32562.log.gz 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31728.log.gz 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27765.log 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33233.log 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31527.log: /var/log/ceph/ceph-client.admin.27765.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31527.log.gz 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27765.log.gz 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32820.log 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33233.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33233.log.gz 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32484.log 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34067.log 2024-04-25T13:47:51.490 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32820.log: /var/log/ceph/ceph-client.admin.32484.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32820.log.gz 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32484.log.gz 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33467.log 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34067.log: /var/log/ceph/ceph-client.admin.33885.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34067.log.gz 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31912.log 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33597.log 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33467.log: /var/log/ceph/ceph-client.admin.31912.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33467.log.gz 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31912.log.gz 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31987.log 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33597.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33597.log.gz 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32692.log 2024-04-25T13:47:51.491 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31987.log: /var/log/ceph/ceph-client.admin.32692.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31987.log.gz 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33259.log 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32692.log.gz 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32970.log 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31858.log 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33259.log: /var/log/ceph/ceph-client.admin.32970.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33259.log.gz 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32970.log.gz 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31806.log 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31858.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31858.log.gz 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33154.log 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32744.log 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31806.log: /var/log/ceph/ceph-client.admin.33154.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31806.log.gz 2024-04-25T13:47:51.492 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31977.log 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33154.log.gz 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32744.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32744.log.gz 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33100.log 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31449.log 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31977.log: /var/log/ceph/ceph-client.admin.33100.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31977.log.gz 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33100.log.gz 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33048.log 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31449.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31449.log.gz 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33126.log 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27545.log 2024-04-25T13:47:51.493 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33048.log: /var/log/ceph/ceph-client.admin.33126.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33048.log.gz 2024-04-25T13:47:51.499 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.22810.log 2024-04-25T13:47:51.501 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33126.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33285.log 2024-04-25T13:47:51.501 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.27545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34145.log 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33285.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.27545.log.gz 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33285.log.gz 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31650.log 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34145.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34145.log.gz 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33649.log 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33623.log 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31650.log: /var/log/ceph/ceph-client.admin.33649.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31650.log.gz 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33649.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32996.log 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33623.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33623.log.gz 2024-04-25T13:47:51.502 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31421.log 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34325.log 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32996.log: /var/log/ceph/ceph-client.admin.31421.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32996.log.gz 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31421.log.gz 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33911.log 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33701.log 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34325.log: /var/log/ceph/ceph-client.admin.33911.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34325.log.gz 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33911.log.gz 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32190.log 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31594.log 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32190.log: /var/log/ceph/ceph-client.admin.33701.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32190.log.gz 2024-04-25T13:47:51.503 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33701.log.gz 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31562.log 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31594.log: /var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31594.log.gz 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34093.log 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31562.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31562.log.gz 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31992.log 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34093.log: /var/log/ceph/ceph-mds.a.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34093.log.gz 2024-04-25T13:47:51.504 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31702.log 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31992.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31992.log.gz 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33779.log 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31702.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31702.log.gz 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31375.log 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22780.log 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33779.log: /var/log/ceph/ceph-client.admin.31375.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33779.log.gz 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31375.log.gz 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33753.log 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.tmp-client.admin.22780.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22780.log.gz 2024-04-25T13:47:51.508 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33493.log 2024-04-25T13:47:51.509 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33363.log 2024-04-25T13:47:51.509 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33753.log: /var/log/ceph/ceph-client.admin.33493.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33753.log.gz 2024-04-25T13:47:51.509 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33571.log 2024-04-25T13:47:51.509 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33493.log.gz 2024-04-25T13:47:51.509 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33363.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33363.log.gz 2024-04-25T13:47:51.512 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32192.log 2024-04-25T13:47:51.512 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31832.log 2024-04-25T13:47:51.512 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33571.log: /var/log/ceph/ceph-client.admin.32192.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33571.log.gz 2024-04-25T13:47:51.512 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32192.log.gz 2024-04-25T13:47:51.512 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33022.log 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33937.log 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31832.log: /var/log/ceph/ceph-client.admin.33022.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31832.log.gz 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33022.log.gz 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34481.log 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32180.log 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34481.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33937.log.gz 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34351.log 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34481.log.gz 2024-04-25T13:47:51.513 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32180.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32180.log.gz 2024-04-25T13:47:51.516 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33207.log 2024-04-25T13:47:51.517 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32536.log 2024-04-25T13:47:51.517 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33207.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34351.log.gz 2024-04-25T13:47:51.517 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32380.log 2024-04-25T13:47:51.517 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32588.log 2024-04-25T13:47:51.517 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33207.log.gz 2024-04-25T13:47:51.518 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32536.log: /var/log/ceph/ceph-client.admin.32380.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32380.log.gz 2024-04-25T13:47:51.518 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32536.log.gz 2024-04-25T13:47:51.518 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32187.log 2024-04-25T13:47:51.518 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33180.log 2024-04-25T13:47:51.518 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32187.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31345.log 2024-04-25T13:47:51.518 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32588.log.gz 2024-04-25T13:47:51.518 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32187.log.gz 2024-04-25T13:47:51.518 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33180.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33180.log.gz 2024-04-25T13:47:51.522 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34299.log 2024-04-25T13:47:51.522 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31938.log 2024-04-25T13:47:51.522 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34299.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31345.log.gz 2024-04-25T13:47:51.522 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31984.log 2024-04-25T13:47:51.522 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34299.log.gz 2024-04-25T13:47:51.522 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31938.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31938.log.gz 2024-04-25T13:47:51.522 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2024-04-25T13:47:51.522 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33963.log 2024-04-25T13:47:51.523 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31991.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31984.log.gz 2024-04-25T13:47:51.523 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34403.log 2024-04-25T13:47:51.523 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33519.log 2024-04-25T13:47:51.523 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2024-04-25T13:47:51.523 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33963.log: /var/log/ceph/ceph-client.admin.34403.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34403.log.gz 2024-04-25T13:47:51.523 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33963.log.gz 2024-04-25T13:47:51.523 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33415.log 2024-04-25T13:47:51.523 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31475.log 2024-04-25T13:47:51.523 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9%/var/log/ceph/ceph-client.admin.33415.log: -- replaced with /var/log/ceph/ceph-client.admin.33519.log.gz 2024-04-25T13:47:51.524 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33415.log.gz 2024-04-25T13:47:51.524 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31475.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31475.log.gz 2024-04-25T13:47:51.610 INFO:teuthology.orchestra.run.smithi096.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T13:47:51.637 INFO:teuthology.orchestra.run.smithi096.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T13:47:51.732 INFO:teuthology.orchestra.run.smithi077.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T13:47:52.233 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-25T13:47:52.545 INFO:teuthology.orchestra.run.smithi077.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T13:47:53.156 INFO:teuthology.orchestra.run.smithi096.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T13:47:53.369 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T13:47:53.431 INFO:teuthology.orchestra.run.smithi096.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T13:47:53.485 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T13:47:53.602 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T13:47:53.603 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-25T13:47:53.604 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m2.176s 2024-04-25T13:47:53.604 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m7.432s 2024-04-25T13:47:53.604 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m0.280s 2024-04-25T13:47:54.484 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T13:47:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.22906.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.22906.log.gz 2024-04-25T13:47:54.537 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-04-25T13:47:54.537 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m3.095s 2024-04-25T13:47:54.537 INFO:teuthology.orchestra.run.smithi097.stderr:user 0m2.995s 2024-04-25T13:47:54.537 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m0.096s 2024-04-25T13:47:54.569 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.1.22883.log: 93.3% -- replaced with /var/log/ceph/ceph-client.1.22883.log.gz 2024-04-25T13:47:54.571 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T13:47:54.571 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m3.115s 2024-04-25T13:47:54.571 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m3.019s 2024-04-25T13:47:54.571 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.098s 2024-04-25T13:47:54.605 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.2.22810.log: 93.4% -- replaced with /var/log/ceph/ceph-client.2.22810.log.gz 2024-04-25T13:47:54.606 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:47:54.607 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m3.137s 2024-04-25T13:47:54.607 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m3.005s 2024-04-25T13:47:54.607 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.123s 2024-04-25T13:47:54.959 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T13:48:22.238 INFO:teuthology.orchestra.run.smithi096.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T13:48:22.239 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-04-25T13:48:22.239 INFO:teuthology.orchestra.run.smithi096.stderr:real 0m30.809s 2024-04-25T13:48:22.239 INFO:teuthology.orchestra.run.smithi096.stderr:user 0m40.019s 2024-04-25T13:48:22.239 INFO:teuthology.orchestra.run.smithi096.stderr:sys 0m1.278s 2024-04-25T13:48:22.240 INFO:tasks.ceph:Archiving logs... 2024-04-25T13:48:22.240 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi077/log 2024-04-25T13:48:22.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:48:23.405 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi096/log 2024-04-25T13:48:23.406 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:48:28.595 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi097/log 2024-04-25T13:48:28.596 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:48:29.032 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi151/log 2024-04-25T13:48:29.034 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:48:29.471 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi191/log 2024-04-25T13:48:29.472 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:48:29.907 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T13:48:29.917 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T13:48:29.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:48:29.921 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:48:29.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:48:29.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:48:29.928 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:48:30.063 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T13:48:30.073 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T13:48:30.074 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:48:30.076 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:48:30.078 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:48:30.081 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:48:30.083 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================== 2024-04-25T13:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:+hv01.front.sepi 67.205.162.81 3 u 43 64 377 0.095 -2.982 1.775 2024-04-25T13:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:+hv02.front.sepi 63.231.80.2 3 u 40 64 377 0.069 +0.415 1.530 2024-04-25T13:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:*hv03.front.sepi 74.6.168.72 3 u 38 64 377 0.094 -1.126 1.838 2024-04-25T13:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-25T13:48:30.089 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:48:30.089 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-25T13:48:30.090 INFO:teuthology.orchestra.run.smithi096.stdout:+hv01.front.sepi 67.205.162.81 3 u 41 64 377 0.048 -2.872 2.346 2024-04-25T13:48:30.090 INFO:teuthology.orchestra.run.smithi096.stdout:+hv02.front.sepi 63.231.80.2 3 u 42 64 377 0.084 -0.259 2.258 2024-04-25T13:48:30.090 INFO:teuthology.orchestra.run.smithi096.stdout:*hv03.front.sepi 74.6.168.72 3 u 36 64 377 0.092 -3.750 1.551 2024-04-25T13:48:30.090 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-25T13:48:30.092 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:48:30.092 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-04-25T13:48:30.092 INFO:teuthology.orchestra.run.smithi097.stdout:*hv01.front.sepi 67.205.162.81 3 u 43 64 377 0.109 -0.846 1.732 2024-04-25T13:48:30.092 INFO:teuthology.orchestra.run.smithi097.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.098 -1.095 2.033 2024-04-25T13:48:30.093 INFO:teuthology.orchestra.run.smithi097.stdout:+hv03.front.sepi 74.6.168.72 3 u 39 64 377 0.070 -1.843 1.070 2024-04-25T13:48:30.093 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-25T13:48:30.094 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:48:30.094 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-04-25T13:48:30.094 INFO:teuthology.orchestra.run.smithi151.stdout:*hv01.front.sepi 67.205.162.81 3 u 49 64 377 0.086 -0.608 0.810 2024-04-25T13:48:30.094 INFO:teuthology.orchestra.run.smithi151.stdout:+hv02.front.sepi 63.231.80.2 3 u 41 64 377 0.090 +2.266 0.967 2024-04-25T13:48:30.094 INFO:teuthology.orchestra.run.smithi151.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.100 -0.991 0.612 2024-04-25T13:48:30.094 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-25T13:48:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:48:30.095 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================== 2024-04-25T13:48:30.095 INFO:teuthology.orchestra.run.smithi191.stdout:+hv01.front.sepi 67.205.162.81 3 u 43 64 377 0.077 -3.646 1.189 2024-04-25T13:48:30.096 INFO:teuthology.orchestra.run.smithi191.stdout:*hv02.front.sepi 63.231.80.2 3 u 40 64 377 0.088 -1.471 1.419 2024-04-25T13:48:30.096 INFO:teuthology.orchestra.run.smithi191.stdout:+hv03.front.sepi 74.6.168.72 3 u 47 64 377 0.102 -4.291 1.734 2024-04-25T13:48:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-25T13:48:30.096 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T13:48:30.106 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T13:48:30.106 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T13:48:30.116 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T13:48:30.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T13:48:30.138 INFO:teuthology.task.internal:Duration was 1138.598901 seconds 2024-04-25T13:48:30.138 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T13:48:30.148 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T13:48:30.148 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:48:30.150 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:48:30.153 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:48:30.155 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:48:30.157 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:48:30.196 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T13:48:30.196 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T13:48:30.196 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:48:30.241 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-04-25T13:48:30.241 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:48:30.252 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-04-25T13:48:30.252 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:48:30.262 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T13:48:30.263 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:48:30.272 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:48:30.272 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:48:30.282 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T13:48:30.283 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:48:30.284 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:48:30.295 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:48:30.306 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:48:30.317 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:48:30.354 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T13:48:30.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:48:30.357 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:48:30.363 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:48:30.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:48:30.392 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:48:30.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T13:48:30.464 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T13:48:30.464 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:48:30.478 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:48:30.491 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:48:30.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:48:30.517 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:48:30.528 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T13:48:30.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.543 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.547 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.550 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-04-25T13:48:30.552 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-04-25T13:48:30.557 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-04-25T13:48:30.561 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.570 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-04-25T13:48:30.580 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-04-25T13:48:30.592 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:48:30.619 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:48:30.630 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:48:30.634 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:48:30.639 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:48:30.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:48:30.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T13:48:30.655 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T13:48:30.656 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi077 2024-04-25T13:48:30.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:48:30.683 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi096 2024-04-25T13:48:30.683 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:48:30.704 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi097 2024-04-25T13:48:30.705 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:48:30.726 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi151 2024-04-25T13:48:30.726 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:48:30.747 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673167/remote/smithi191 2024-04-25T13:48:30.747 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:48:30.769 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T13:48:30.769 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:48:30.772 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:48:30.774 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:48:30.777 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:48:30.789 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:48:30.814 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T13:48:30.826 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T13:48:30.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T13:48:30.837 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T13:48:30.837 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:48:30.840 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:48:30.842 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:48:30.843 INFO:teuthology.orchestra.run.smithi077.stdout: 658467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:48 /home/ubuntu/cephtest 2024-04-25T13:48:30.845 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:48:30.846 INFO:teuthology.orchestra.run.smithi096.stdout: 658467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:48 /home/ubuntu/cephtest 2024-04-25T13:48:30.848 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:48:30.848 INFO:teuthology.orchestra.run.smithi097.stdout: 658617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:48 /home/ubuntu/cephtest 2024-04-25T13:48:30.851 INFO:teuthology.orchestra.run.smithi151.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:48 /home/ubuntu/cephtest 2024-04-25T13:48:30.862 INFO:teuthology.orchestra.run.smithi191.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:48 /home/ubuntu/cephtest 2024-04-25T13:48:30.863 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T13:48:30.873 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T13:48:30.898 INFO:teuthology.run:Summary data: description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/mdtest} duration: 1138.598900794983 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T13:48:30.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:48:30.994 INFO:teuthology.run:pass